Oct 20 16:15:04 user nova-compute[74131]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74131) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 16:15:04 user nova-compute[74131]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74131) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 16:15:04 user nova-compute[74131]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74131) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 16:15:04 user nova-compute[74131]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 16:15:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:15:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.023s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:15:04 user nova-compute[74131]: INFO nova.virt.driver [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 16:15:05 user nova-compute[74131]: INFO nova.compute.provider_config [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Acquiring lock "singleton_lock" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Acquired lock "singleton_lock" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Releasing lock "singleton_lock" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Full set of CONF: {{(pid=74131) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ******************************************************************************** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Configuration options gathered from: {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ================================================================================ {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] allow_resize_to_same_host      = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] arq_binding_timeout            = 300 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] backdoor_port                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] backdoor_socket                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] block_device_allocate_retries  = 300 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] block_device_allocate_retries_interval = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cert                           = self.pem {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute_monitors               = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] config_dir                     = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] config_drive_format            = iso9660 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] config_source                  = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] console_host                   = user {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] control_exchange               = nova {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cpu_allocation_ratio           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] daemon                         = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] debug                          = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] default_access_ip_network_name = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] default_availability_zone      = nova {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] default_ephemeral_format       = ext4 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] default_green_pool_size        = 1000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] default_schedule_zone          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] disk_allocation_ratio          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] enable_new_services            = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] enabled_apis                   = ['osapi_compute'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] enabled_ssl_apis               = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] flat_injected                  = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] force_config_drive             = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] force_raw_images               = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] graceful_shutdown_timeout      = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] heal_instance_info_cache_interval = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] host                           = user {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instance_build_timeout         = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instance_delete_interval       = 300 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instance_format                = [instance: %(uuid)s]  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instance_name_template         = instance-%08x {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instance_usage_audit           = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instance_usage_audit_period    = month {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] internal_service_availability_zone = internal {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] key                            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] live_migration_retry_count     = 30 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_config_append              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_dir                        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_file                       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_options                    = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_rotate_interval            = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_rotate_interval_type       = days {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] log_rotation_type              = none {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] long_rpc_timeout               = 1800 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] max_concurrent_builds          = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] max_concurrent_live_migrations = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] max_concurrent_snapshots       = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] max_local_block_devices        = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] max_logfile_count              = 30 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] max_logfile_size_mb            = 200 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] maximum_instance_delete_attempts = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] metadata_listen                = 0.0.0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] metadata_listen_port           = 8775 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] metadata_workers               = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] migrate_max_retries            = -1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] mkisofs_cmd                    = genisoimage {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] my_ip                          = 10.0.0.210 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] network_allocate_retries       = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] osapi_compute_listen_port      = 8774 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] osapi_compute_unique_server_name_scope =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] osapi_compute_workers          = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] password_length                = 12 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] periodic_enable                = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] periodic_fuzzy_delay           = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] pointer_model                  = ps2mouse {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] preallocate_images             = none {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] publish_errors                 = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] pybasedir                      = /opt/stack/nova {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ram_allocation_ratio           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rate_limit_burst               = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rate_limit_except_level        = CRITICAL {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rate_limit_interval            = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] reboot_timeout                 = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] reclaim_instance_interval      = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] record                         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] reimage_timeout_per_gb         = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] report_interval                = 120 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rescue_timeout                 = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] reserved_host_cpus             = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] reserved_host_disk_mb          = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] reserved_host_memory_mb        = 512 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] reserved_huge_pages            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] resize_confirm_window          = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] resize_fs_using_block_device   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] resume_guests_state_on_host_boot = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rpc_response_timeout           = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] run_external_periodic_tasks    = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] running_deleted_instance_action = reap {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] running_deleted_instance_poll_interval = 1800 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] running_deleted_instance_timeout = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler_instance_sync_interval = 120 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_down_time              = 720 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] servicegroup_driver            = db {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] shelved_offload_time           = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] shelved_poll_interval          = 3600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] shutdown_timeout               = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] source_is_ipv6                 = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ssl_only                       = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] state_path                     = /opt/stack/data/nova {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] sync_power_state_interval      = 600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] sync_power_state_pool_size     = 1000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] syslog_log_facility            = LOG_USER {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] tempdir                        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] timeout_nbd                    = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] transport_url                  = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] update_resources_interval      = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] use_cow_images                 = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] use_eventlog                   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] use_journal                    = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] use_json                       = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] use_rootwrap_daemon            = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] use_stderr                     = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] use_syslog                     = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vcpu_pin_set                   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plugging_is_fatal          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plugging_timeout           = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] virt_mkfs                      = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] volume_usage_poll_interval     = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] watch_log_file                 = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] web                            = /usr/share/spice-html5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_concurrency.disable_process_locking = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.auth_strategy              = keystone {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.compute_link_prefix        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.dhcp_domain                = novalocal {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.enable_instance_password   = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.glance_link_prefix         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.instance_list_per_project_cells = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.list_records_by_skipping_down_cells = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.local_metadata_per_cell    = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.max_limit                  = 1000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.metadata_cache_expiration  = 15 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.neutron_default_tenant_id  = default {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.use_forwarded_for          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.use_neutron_default_nets   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.vendordata_dynamic_targets = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.vendordata_jsonfile_path   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.backend                  = dogpile.cache.memcached {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.backend_argument         = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.config_prefix            = cache.oslo {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.dead_timeout             = 60.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.debug_cache_backend      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.enable_retry_client      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.enable_socket_keepalive  = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.enabled                  = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.expiration_time          = 600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.hashclient_retry_attempts = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_dead_retry      = 300 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_password        =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_pool_maxsize    = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_sasl_enabled    = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.memcache_username        =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.proxies                  = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.retry_attempts           = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.retry_delay              = 0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.socket_keepalive_count   = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.socket_keepalive_idle    = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.socket_keepalive_interval = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.tls_allowed_ciphers      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.tls_cafile               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.tls_certfile             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.tls_enabled              = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cache.tls_keyfile              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.auth_section            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.auth_type               = password {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.cafile                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.certfile                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.collect_timing          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.cross_az_attach         = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.debug                   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.endpoint_template       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.http_retries            = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.insecure                = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.keyfile                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.os_region_name          = RegionOne {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.split_loggers           = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cinder.timeout                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.cpu_dedicated_set      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.cpu_shared_set         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.image_type_exclude_list = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.max_concurrent_disk_ops = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.max_disk_devices_to_attach = -1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.resource_provider_association_refresh = 300 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.shutdown_retry_interval = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] conductor.workers              = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] console.allowed_origins        = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] console.ssl_ciphers            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] console.ssl_minimum_version    = default {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] consoleauth.token_ttl          = 600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.cafile                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.certfile                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.collect_timing          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.connect_retries         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.connect_retry_delay     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.endpoint_override       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.insecure                = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.keyfile                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.max_version             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.min_version             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.region_name             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.service_name            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.service_type            = accelerator {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.split_loggers           = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.status_code_retries     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.status_code_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.timeout                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] cyborg.version                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.backend               = sqlalchemy {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.connection            = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.connection_debug      = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.connection_parameters =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.connection_recycle_time = 3600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.connection_trace      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.db_inc_retry_interval = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.db_max_retries        = 20 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.db_max_retry_interval = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.db_retry_interval     = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.max_overflow          = 50 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.max_pool_size         = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.max_retries           = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.mysql_wsrep_sync_wait = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.pool_timeout          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.retry_interval        = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.slave_connection      = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] database.sqlite_synchronous    = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.backend           = sqlalchemy {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.connection        = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.connection_debug  = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.connection_parameters =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.connection_recycle_time = 3600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.connection_trace  = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.db_inc_retry_interval = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.db_max_retries    = 20 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.db_max_retry_interval = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.db_retry_interval = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.max_overflow      = 50 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.max_pool_size     = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.max_retries       = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.pool_timeout      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.retry_interval    = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.slave_connection  = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] api_database.sqlite_synchronous = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] devices.enabled_mdev_types     = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ephemeral_storage_encryption.enabled = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.api_servers             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.cafile                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.certfile                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.collect_timing          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.connect_retries         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.connect_retry_delay     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.debug                   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.default_trusted_certificate_ids = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.enable_certificate_validation = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.enable_rbd_download     = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.endpoint_override       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.insecure                = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.keyfile                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.max_version             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.min_version             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.num_retries             = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.rbd_ceph_conf           =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.rbd_connect_timeout     = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.rbd_pool                =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.rbd_user                =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.region_name             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.service_name            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.service_type            = image {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.split_loggers           = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.status_code_retries     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.status_code_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.timeout                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.verify_glance_signatures = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] glance.version                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] guestfs.debug                  = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.config_drive_cdrom      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.config_drive_inject_password = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.enable_instance_metrics_collection = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.enable_remotefx         = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.instances_path_share    =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.iscsi_initiator_list    = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.limit_cpu_features      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.power_state_check_timeframe = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.use_multipath_io        = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.volume_attach_retry_count = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.vswitch_name            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] mks.enabled                    = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] image_cache.manager_interval   = 2400 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] image_cache.precache_concurrency = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] image_cache.remove_unused_base_images = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] image_cache.subdirectory_name  = _base {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.api_max_retries         = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.api_retry_interval      = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.auth_section            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.auth_type               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.cafile                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.certfile                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.collect_timing          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.conductor_group         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.connect_retries         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.connect_retry_delay     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.endpoint_override       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.insecure                = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.keyfile                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.max_version             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.min_version             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.peer_list               = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.region_name             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.serial_console_state_timeout = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.service_name            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.service_type            = baremetal {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.split_loggers           = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.status_code_retries     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.status_code_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.timeout                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ironic.version                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] key_manager.fixed_key          = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.barbican_api_version  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.barbican_endpoint     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.barbican_endpoint_type = public {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.barbican_region_name  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.cafile                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.certfile              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.collect_timing        = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.insecure              = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.keyfile               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.number_of_retries     = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.retry_delay           = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.send_service_user_token = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.split_loggers         = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.timeout               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.verify_ssl            = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican.verify_ssl_path       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.auth_section = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.auth_type = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.cafile   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.certfile = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.collect_timing = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.insecure = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.keyfile  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.split_loggers = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] barbican_service_user.timeout  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.approle_role_id          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.approle_secret_id        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.cafile                   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.certfile                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.collect_timing           = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.insecure                 = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.keyfile                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.kv_mountpoint            = secret {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.kv_path                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.kv_version               = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.namespace                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.root_token_id            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.split_loggers            = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.ssl_ca_crt_file          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.timeout                  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.use_ssl                  = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.auth_section          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.auth_type             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.cafile                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.certfile              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.collect_timing        = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.connect_retries       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.connect_retry_delay   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.endpoint_override     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.insecure              = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.keyfile               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.max_version           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.min_version           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.region_name           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.service_name          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.service_type          = identity {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.split_loggers         = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.status_code_retries   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.status_code_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.timeout               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] keystone.version               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.connection_uri         =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.cpu_mode               = custom {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: WARNING oslo_config.cfg [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.cpu_power_governor_high = performance {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.cpu_power_governor_low = powersave {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.cpu_power_management   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.device_detach_attempts = 8 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.device_detach_timeout  = 20 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.disk_cachemodes        = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.disk_prefix            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.enabled_perf_events    = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.file_backed_memory     = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.gid_maps               = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.hw_disk_discard        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.hw_machine_type        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.images_rbd_glance_store_name =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.images_rbd_pool        = rbd {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.images_type            = default {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.images_volume_group    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.inject_key             = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.inject_partition       = -2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.inject_password        = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.iscsi_iface            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.iser_use_multipath     = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_bandwidth = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_downtime = 500 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_inbound_addr = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_permit_post_copy = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_scheme  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_timeout_action = abort {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_tunnelled = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: WARNING oslo_config.cfg [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 16:15:05 user nova-compute[74131]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 16:15:05 user nova-compute[74131]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 16:15:05 user nova-compute[74131]: and ``live_migration_inbound_addr`` respectively.
Oct 20 16:15:05 user nova-compute[74131]: ).  Its value may be silently ignored in the future.
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.live_migration_with_native_tls = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.max_queues             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.nfs_mount_options      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.num_memory_encrypted_guests = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.num_pcie_ports         = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.pmem_namespaces        = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.quobyte_client_cfg     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rbd_secret_uuid        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rbd_user               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.remote_filesystem_transport = ssh {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rescue_image_id        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rescue_kernel_id       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rescue_ramdisk_id      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.rx_queue_size          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.smbfs_mount_options    =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.snapshot_compression   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.snapshot_image_format  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.sparse_logical_volumes = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.swtpm_enabled          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.swtpm_group            = tss {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.swtpm_user             = tss {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.sysinfo_serial         = unique {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.tb_cache_size          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.tx_queue_size          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.uid_maps               = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.use_virtio_for_bridges = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.virt_type              = kvm {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.volume_clear           = zero {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.volume_clear_size      = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.volume_use_multipath   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.vzstorage_cache_path   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.vzstorage_mount_user   = stack {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.auth_section           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.auth_type              = password {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.cafile                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.certfile               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.collect_timing         = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.connect_retries        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.connect_retry_delay    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.default_floating_pool  = public {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.endpoint_override      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.extension_sync_interval = 600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.http_retries           = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.insecure               = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.keyfile                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.max_version            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.min_version            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.ovs_bridge             = br-int {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.physnets               = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.region_name            = RegionOne {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.service_metadata_proxy = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.service_name           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.service_type           = network {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.split_loggers          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.status_code_retries    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.status_code_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.timeout                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] neutron.version                = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] notifications.bdms_in_notifications = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] notifications.default_level    = INFO {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] notifications.notification_format = unversioned {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] notifications.notify_on_state_change = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] pci.alias                      = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] pci.device_spec                = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] pci.report_in_placement        = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.auth_section         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.auth_type            = password {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.cafile               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.certfile             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.collect_timing       = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.connect_retries      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.connect_retry_delay  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.default_domain_id    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.default_domain_name  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.domain_id            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.domain_name          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.endpoint_override    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.insecure             = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.keyfile              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.max_version          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.min_version          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.password             = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.project_domain_id    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.project_domain_name  = Default {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.project_id           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.project_name         = service {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.region_name          = RegionOne {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.service_name         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.service_type         = placement {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.split_loggers        = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.status_code_retries  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.status_code_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.system_scope         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.timeout              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.trust_id             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.user_domain_id       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.user_domain_name     = Default {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.user_id              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.username             = placement {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] placement.version              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.cores                    = 20 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.count_usage_from_placement = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.injected_file_content_bytes = 10240 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.injected_file_path_length = 255 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.injected_files           = 5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.instances                = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.key_pairs                = 100 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.metadata_items           = 128 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.ram                      = 51200 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.recheck_quota            = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.server_group_members     = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] quota.server_groups            = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rdp.enabled                    = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.image_metadata_prefilter = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.max_attempts         = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.max_placement_results = 1000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.query_placement_for_image_type_support = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] scheduler.workers              = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.host_subset_size = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.isolated_hosts = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.isolated_images = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.pci_in_placement = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.track_instance_changes = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] metrics.required               = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] metrics.weight_multiplier      = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] metrics.weight_setting         = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] serial_console.enabled         = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] serial_console.port_range      = 10000:20000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] serial_console.serialproxy_port = 6083 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.auth_section      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.auth_type         = password {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.cafile            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.certfile          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.collect_timing    = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.insecure          = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.keyfile           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.send_service_user_token = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.split_loggers     = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] service_user.timeout           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.agent_enabled            = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.enabled                  = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.html5proxy_port          = 6082 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.image_compression        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.jpeg_compression         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.playback_compression     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.server_listen            = 127.0.0.1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.streaming_mode           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] spice.zlib_compression         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] upgrade_levels.baseapi         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] upgrade_levels.cert            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] upgrade_levels.compute         = auto {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] upgrade_levels.conductor       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] upgrade_levels.scheduler       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.auth_section = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.auth_type = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.cafile = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.certfile = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.insecure = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.keyfile = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vendordata_dynamic_auth.timeout = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.api_retry_count         = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.ca_file                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.cache_prefix            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.cluster_name            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.connection_pool_size    = 10 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.console_delay_seconds   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.datastore_regex         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.host_ip                 = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.host_password           = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.host_port               = 443 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.host_username           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.insecure                = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.integration_bridge      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.maximum_objects         = 100 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.pbm_default_policy      = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.pbm_enabled             = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.pbm_wsdl_location       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.serial_port_proxy_uri   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.serial_port_service_uri = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.task_poll_interval      = 0.5 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.use_linked_clone        = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.vnc_keymap              = en-us {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.vnc_port                = 5900 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vmware.vnc_port_total          = 10000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.auth_schemes               = ['none'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.enabled                    = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.novncproxy_port            = 6080 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.server_listen              = 0.0.0.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.vencrypt_ca_certs          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.vencrypt_client_cert       = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vnc.vencrypt_client_key        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.disable_rootwrap   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.enable_numa_live_migration = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.libvirt_disable_apic = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.client_socket_timeout     = 900 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.default_pool_size         = 1000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.keep_alive                = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.max_header_line           = 16384 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.ssl_ca_file               = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.ssl_cert_file             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.ssl_key_file              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.tcp_keepidle              = 600 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] zvm.ca_file                    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] zvm.cloud_connector_url        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] zvm.reachable_timeout          = 300 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.enforce_new_defaults = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.enforce_scope      = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.policy_default_rule = default {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.policy_file        = policy.yaml {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.connection_string     = messaging:// {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.enabled               = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.es_doc_type           = notification {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.es_scroll_size        = 10000 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.es_scroll_time        = 2m {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.filter_error_trace    = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.hmac_keys             = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.sentinel_service_name = mymaster {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.socket_timeout        = 0.1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.trace_requests        = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler.trace_sqlalchemy      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler_jaeger.process_tags   = {} {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler_jaeger.service_name_prefix = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] profiler_otlp.service_name_prefix = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] remote_debug.host              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] remote_debug.port              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.ssl      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_notifications.retry = -1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_messaging_notifications.transport_url = **** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.auth_section        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.auth_type           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.cafile              = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.certfile            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.collect_timing      = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.connect_retries     = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.connect_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.endpoint_id         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.endpoint_override   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.insecure            = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.keyfile             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.max_version         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.min_version         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.region_name         = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.service_name        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.service_type        = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.split_loggers       = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.status_code_retries = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.status_code_retry_delay = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.timeout             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.valid_interfaces    = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_limit.version             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_reports.file_event_handler = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] oslo_reports.log_dir           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_ovs_privileged.group  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] vif_plug_ovs_privileged.user   = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.flat_interface = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_ovs.isolate_vif         = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_vif_ovs.per_port_bridge     = False {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] os_brick.lock_path             = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] privsep_osbrick.capabilities   = [21] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] privsep_osbrick.group          = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] privsep_osbrick.helper_command = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] privsep_osbrick.user           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] nova_sys_admin.group           = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] nova_sys_admin.helper_command  = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] nova_sys_admin.user            = None {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG oslo_service.service [None req-c8d715d2-815c-4006-90b3-9ccae36326aa None None] ******************************************************************************** {{(pid=74131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 16:15:05 user nova-compute[74131]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 16:15:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Connecting to libvirt: qemu:///system {{(pid=74131) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f70e8a92500> {{(pid=74131) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 16:15:05 user nova-compute[74131]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 16:15:05 user nova-compute[74131]: WARNING nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 16:15:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f70e8a92500> {{(pid=74131) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Starting native event thread {{(pid=74131) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Starting green dispatch thread {{(pid=74131) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 16:15:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Starting connection event dispatch thread {{(pid=74131) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 16:15:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Connection event '1' reason 'None'
Oct 20 16:15:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 16:15:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.mount [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Initialising _HostMountState generation 0 {{(pid=74131) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 16:15:12 user nova-compute[74131]: INFO nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host capabilities <capabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <host>
Oct 20 16:15:12 user nova-compute[74131]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 16:15:12 user nova-compute[74131]:     <cpu>
Oct 20 16:15:12 user nova-compute[74131]:       <arch>x86_64</arch>
Oct 20 16:15:12 user nova-compute[74131]:       <model>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <microcode version='1070'/>
Oct 20 16:15:12 user nova-compute[74131]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 16:15:12 user nova-compute[74131]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='osxsave'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='invtsc'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='rsba'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 16:15:12 user nova-compute[74131]:       <pages unit='KiB' size='4'/>
Oct 20 16:15:12 user nova-compute[74131]:       <pages unit='KiB' size='2048'/>
Oct 20 16:15:12 user nova-compute[74131]:     </cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <power_management>
Oct 20 16:15:12 user nova-compute[74131]:       <suspend_mem/>
Oct 20 16:15:12 user nova-compute[74131]:       <suspend_disk/>
Oct 20 16:15:12 user nova-compute[74131]:       <suspend_hybrid/>
Oct 20 16:15:12 user nova-compute[74131]:     </power_management>
Oct 20 16:15:12 user nova-compute[74131]:     <iommu support='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <migration_features>
Oct 20 16:15:12 user nova-compute[74131]:       <live/>
Oct 20 16:15:12 user nova-compute[74131]:       <uri_transports>
Oct 20 16:15:12 user nova-compute[74131]:         <uri_transport>tcp</uri_transport>
Oct 20 16:15:12 user nova-compute[74131]:         <uri_transport>rdma</uri_transport>
Oct 20 16:15:12 user nova-compute[74131]:       </uri_transports>
Oct 20 16:15:12 user nova-compute[74131]:     </migration_features>
Oct 20 16:15:12 user nova-compute[74131]:     <topology>
Oct 20 16:15:12 user nova-compute[74131]:       <cells num='2'>
Oct 20 16:15:12 user nova-compute[74131]:         <cell id='0'>
Oct 20 16:15:12 user nova-compute[74131]:           <memory unit='KiB'>8140616</memory>
Oct 20 16:15:12 user nova-compute[74131]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 20 16:15:12 user nova-compute[74131]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 16:15:12 user nova-compute[74131]:           <distances>
Oct 20 16:15:12 user nova-compute[74131]:             <sibling id='0' value='10'/>
Oct 20 16:15:12 user nova-compute[74131]:             <sibling id='1' value='20'/>
Oct 20 16:15:12 user nova-compute[74131]:           </distances>
Oct 20 16:15:12 user nova-compute[74131]:           <cpus num='6'>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 16:15:12 user nova-compute[74131]:           </cpus>
Oct 20 16:15:12 user nova-compute[74131]:         </cell>
Oct 20 16:15:12 user nova-compute[74131]:         <cell id='1'>
Oct 20 16:15:12 user nova-compute[74131]:           <memory unit='KiB'>8255100</memory>
Oct 20 16:15:12 user nova-compute[74131]:           <pages unit='KiB' size='4'>2063775</pages>
Oct 20 16:15:12 user nova-compute[74131]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 16:15:12 user nova-compute[74131]:           <distances>
Oct 20 16:15:12 user nova-compute[74131]:             <sibling id='0' value='20'/>
Oct 20 16:15:12 user nova-compute[74131]:             <sibling id='1' value='10'/>
Oct 20 16:15:12 user nova-compute[74131]:           </distances>
Oct 20 16:15:12 user nova-compute[74131]:           <cpus num='6'>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 16:15:12 user nova-compute[74131]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 16:15:12 user nova-compute[74131]:           </cpus>
Oct 20 16:15:12 user nova-compute[74131]:         </cell>
Oct 20 16:15:12 user nova-compute[74131]:       </cells>
Oct 20 16:15:12 user nova-compute[74131]:     </topology>
Oct 20 16:15:12 user nova-compute[74131]:     <cache>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 16:15:12 user nova-compute[74131]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 16:15:12 user nova-compute[74131]:     </cache>
Oct 20 16:15:12 user nova-compute[74131]:     <secmodel>
Oct 20 16:15:12 user nova-compute[74131]:       <model>apparmor</model>
Oct 20 16:15:12 user nova-compute[74131]:       <doi>0</doi>
Oct 20 16:15:12 user nova-compute[74131]:     </secmodel>
Oct 20 16:15:12 user nova-compute[74131]:     <secmodel>
Oct 20 16:15:12 user nova-compute[74131]:       <model>dac</model>
Oct 20 16:15:12 user nova-compute[74131]:       <doi>0</doi>
Oct 20 16:15:12 user nova-compute[74131]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 16:15:12 user nova-compute[74131]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 16:15:12 user nova-compute[74131]:     </secmodel>
Oct 20 16:15:12 user nova-compute[74131]:   </host>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='alpha'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>clipper</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='armv6l'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>spitz</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>nuri</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>kzm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sx1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>z2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>tosa</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>n810</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>n800</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>terrier</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>midway</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>microbit</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>verdex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>highbank</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>akita</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>connex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>collie</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='armv7l'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>spitz</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>nuri</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>kzm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sx1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>z2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>tosa</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>n810</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>n800</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>terrier</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>midway</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>microbit</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>verdex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>highbank</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>akita</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>connex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>collie</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='aarch64'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>spitz</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>nuri</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>kzm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sx1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>z2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>tosa</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>n810</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>n800</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>terrier</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>midway</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>microbit</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>verdex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>highbank</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>akita</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>connex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>collie</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <acpi default='on' toggle='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='cris'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='i686'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>isapc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>microvm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='kvm'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <pae/>
Oct 20 16:15:12 user nova-compute[74131]:       <nonpae/>
Oct 20 16:15:12 user nova-compute[74131]:       <acpi default='on' toggle='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:       <apic default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='m68k'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>an5206</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>q800</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='microblaze'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='microblazeel'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='mips'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='16'>malta</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='mipsel'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='16'>malta</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='mips64'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='16'>malta</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>pica61</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>magnum</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='mips64el'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='16'>malta</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>pica61</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>magnum</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='16'>boston</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='ppc'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mac99</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>40p</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>taihu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='ppc64'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>taihu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>40p</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mac99</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='ppc64le'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>taihu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>40p</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>mac99</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='riscv32'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='8'>spike</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='8'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='riscv64'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='8'>spike</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='8'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='s390x'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='sh4'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>shix</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>r2d</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='sh4eb'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>shix</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>r2d</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='sparc'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>LX</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='sparc64'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>niagara</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='x86_64'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>64</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='1'>isapc</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>microvm</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='kvm'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <acpi default='on' toggle='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:       <apic default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='xtensa'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>sim</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>kc705</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>ml605</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx200</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx60</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]:   <guest>
Oct 20 16:15:12 user nova-compute[74131]:     <os_type>hvm</os_type>
Oct 20 16:15:12 user nova-compute[74131]:     <arch name='xtensaeb'>
Oct 20 16:15:12 user nova-compute[74131]:       <wordsize>32</wordsize>
Oct 20 16:15:12 user nova-compute[74131]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='4'>sim</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>kc705</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>ml605</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>virt</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx200</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>lx60</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 16:15:12 user nova-compute[74131]:       <domain type='qemu'/>
Oct 20 16:15:12 user nova-compute[74131]:     </arch>
Oct 20 16:15:12 user nova-compute[74131]:     <features>
Oct 20 16:15:12 user nova-compute[74131]:       <cpuselection/>
Oct 20 16:15:12 user nova-compute[74131]:       <deviceboot/>
Oct 20 16:15:12 user nova-compute[74131]:       <disksnapshot default='on' toggle='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     </features>
Oct 20 16:15:12 user nova-compute[74131]:   </guest>
Oct 20 16:15:12 user nova-compute[74131]: </capabilities>
Oct 20 16:15:12 user nova-compute[74131]: 
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-q35-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>i686</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='288'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'/>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='lm'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-q35-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>i686</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='288'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'/>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='lm'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-i440fx-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>i686</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='255'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'/>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='lm'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ide</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-i440fx-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>i686</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='255'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'/>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='lm'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ide</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-q35-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>x86_64</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='288'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>efi</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='invtsc'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='rsba'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-q35-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>x86_64</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='288'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>efi</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='invtsc'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='rsba'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-i440fx-6.2</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>x86_64</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='255'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>efi</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='invtsc'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='rsba'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ide</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 16:15:12 user nova-compute[74131]: <domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 16:15:12 user nova-compute[74131]:   <domain>kvm</domain>
Oct 20 16:15:12 user nova-compute[74131]:   <machine>pc-i440fx-jammy</machine>
Oct 20 16:15:12 user nova-compute[74131]:   <arch>x86_64</arch>
Oct 20 16:15:12 user nova-compute[74131]:   <vcpu max='255'/>
Oct 20 16:15:12 user nova-compute[74131]:   <iothreads supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:   <os supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='firmware'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>efi</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:     <loader supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>rom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pflash</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='readonly'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>yes</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='secure'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>no</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </loader>
Oct 20 16:15:12 user nova-compute[74131]:   </os>
Oct 20 16:15:12 user nova-compute[74131]:   <cpu>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-passthrough' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='hostPassthroughMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='maximum' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='maximumMigratable'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>on</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>off</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='host-model' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <vendor>Intel</vendor>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ss'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='vmx'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pcid'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='hypervisor'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arat'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='umip'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='md-clear'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='invtsc'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibpb'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='ibrs'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-stibp'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='rsba'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='erms'/>
Oct 20 16:15:12 user nova-compute[74131]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:     <mode name='custom' supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>qemu64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>qemu32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>phenom</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>pentium</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>n270</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm64</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>kvm32</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>coreduo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>core2duo</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>athlon</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Westmere</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Snowridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Skylake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>SandyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Penryn</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G5</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G4</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G3</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Opteron_G2</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Opteron_G1</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>IvyBridge</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Icelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Haswell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Rome</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-Milan</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>EPYC</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Dhyana</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cooperlake</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>Conroe</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='no'>Broadwell</model>
Oct 20 16:15:12 user nova-compute[74131]:       <model usable='yes'>486</model>
Oct 20 16:15:12 user nova-compute[74131]:     </mode>
Oct 20 16:15:12 user nova-compute[74131]:   </cpu>
Oct 20 16:15:12 user nova-compute[74131]:   <memoryBacking supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:     <enum name='sourceType'>
Oct 20 16:15:12 user nova-compute[74131]:       <value>file</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>anonymous</value>
Oct 20 16:15:12 user nova-compute[74131]:       <value>memfd</value>
Oct 20 16:15:12 user nova-compute[74131]:     </enum>
Oct 20 16:15:12 user nova-compute[74131]:   </memoryBacking>
Oct 20 16:15:12 user nova-compute[74131]:   <devices>
Oct 20 16:15:12 user nova-compute[74131]:     <disk supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='diskDevice'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>disk</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cdrom</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>floppy</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>lun</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='bus'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ide</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>fdc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sata</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </disk>
Oct 20 16:15:12 user nova-compute[74131]:     <graphics supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='type'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>sdl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vnc</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>spice</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egl-headless</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </graphics>
Oct 20 16:15:12 user nova-compute[74131]:     <video supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='modelType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>cirrus</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>vmvga</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>qxl</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>none</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>bochs</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>ramfb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </video>
Oct 20 16:15:12 user nova-compute[74131]:     <hostdev supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='mode'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>subsystem</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='startupPolicy'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>default</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>mandatory</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>requisite</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>optional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='subsysType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>usb</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>pci</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>scsi</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='capsType'/>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='pciBackend'/>
Oct 20 16:15:12 user nova-compute[74131]:     </hostdev>
Oct 20 16:15:12 user nova-compute[74131]:     <rng supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtio-non-transitional</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>random</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>egd</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>builtin</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </rng>
Oct 20 16:15:12 user nova-compute[74131]:     <filesystem supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='driverType'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>path</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>handle</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>virtiofs</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </filesystem>
Oct 20 16:15:12 user nova-compute[74131]:     <tpm supported='yes'>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='model'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-tis</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>tpm-crb</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:       <enum name='backendModel'>
Oct 20 16:15:12 user nova-compute[74131]:         <value>passthrough</value>
Oct 20 16:15:12 user nova-compute[74131]:         <value>emulator</value>
Oct 20 16:15:12 user nova-compute[74131]:       </enum>
Oct 20 16:15:12 user nova-compute[74131]:     </tpm>
Oct 20 16:15:12 user nova-compute[74131]:   </devices>
Oct 20 16:15:12 user nova-compute[74131]:   <features>
Oct 20 16:15:12 user nova-compute[74131]:     <gic supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:     <vmcoreinfo supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <genid supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backingStoreInput supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <backup supported='yes'/>
Oct 20 16:15:12 user nova-compute[74131]:     <sev supported='no'/>
Oct 20 16:15:12 user nova-compute[74131]:   </features>
Oct 20 16:15:12 user nova-compute[74131]: </domainCapabilities>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74131) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74131) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Checking secure boot support for host arch (x86_64) {{(pid=74131) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 16:15:12 user nova-compute[74131]: INFO nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Secure Boot support detected
Oct 20 16:15:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] cpu compare xml: <cpu match="exact">
Oct 20 16:15:12 user nova-compute[74131]:   <model>Nehalem</model>
Oct 20 16:15:12 user nova-compute[74131]: </cpu>
Oct 20 16:15:12 user nova-compute[74131]:  {{(pid=74131) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 16:15:12 user nova-compute[74131]: INFO nova.virt.node [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Generated node identity bae45930-01a8-4277-ad36-8055d9898c12
Oct 20 16:15:12 user nova-compute[74131]: INFO nova.virt.node [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Wrote node identity bae45930-01a8-4277-ad36-8055d9898c12 to /opt/stack/data/nova/compute_id
Oct 20 16:15:12 user nova-compute[74131]: WARNING nova.compute.manager [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Compute nodes ['bae45930-01a8-4277-ad36-8055d9898c12'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 16:15:12 user nova-compute[74131]: INFO nova.compute.manager [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 16:15:13 user nova-compute[74131]: WARNING nova.compute.manager [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 16:15:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:15:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:15:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Hypervisor/Node resource view: name=user free_ram=10909MB free_disk=26.17715835571289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:15:13 user nova-compute[74131]: WARNING nova.compute.resource_tracker [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] No compute node record for user:bae45930-01a8-4277-ad36-8055d9898c12: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host bae45930-01a8-4277-ad36-8055d9898c12 could not be found.
Oct 20 16:15:13 user nova-compute[74131]: INFO nova.compute.resource_tracker [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Compute node record created for user:user with uuid: bae45930-01a8-4277-ad36-8055d9898c12
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:15:13 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] [req-dfda6cd4-eb80-49e1-8866-a9c514722581] Created resource provider record via placement API for resource provider with UUID bae45930-01a8-4277-ad36-8055d9898c12 and name user.
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74131) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 16:15:13 user nova-compute[74131]: INFO nova.virt.libvirt.host [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] kernel doesn't support AMD SEV
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Libvirt baseline CPU <cpu>
Oct 20 16:15:13 user nova-compute[74131]:   <arch>x86_64</arch>
Oct 20 16:15:13 user nova-compute[74131]:   <model>Nehalem</model>
Oct 20 16:15:13 user nova-compute[74131]:   <vendor>Intel</vendor>
Oct 20 16:15:13 user nova-compute[74131]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 16:15:13 user nova-compute[74131]: </cpu>
Oct 20 16:15:13 user nova-compute[74131]:  {{(pid=74131) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Updated inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Updating resource provider bae45930-01a8-4277-ad36-8055d9898c12 generation from 0 to 1 during operation: update_inventory {{(pid=74131) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Updating resource provider bae45930-01a8-4277-ad36-8055d9898c12 generation from 1 to 2 during operation: update_traits {{(pid=74131) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:15:13 user nova-compute[74131]: DEBUG nova.service [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Creating RPC server for service compute {{(pid=74131) start /opt/stack/nova/nova/service.py:182}}
Oct 20 16:15:14 user nova-compute[74131]: DEBUG nova.service [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] Join ServiceGroup membership for this service compute {{(pid=74131) start /opt/stack/nova/nova/service.py:199}}
Oct 20 16:15:14 user nova-compute[74131]: DEBUG nova.servicegroup.drivers.db [None req-21bf2f73-1151-4bba-a135-6540ad3000ac None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74131) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 16:15:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:15:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:16:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:16:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:16:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:16:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=10382MB free_disk=26.080936431884766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:16:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:17:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:17:06 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:17:06 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:17:06 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=10300MB free_disk=26.145912170410156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:17:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:17:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:17:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:18:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:18:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:18:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:18:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:18:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:18:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:18:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:18:08 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:18:08 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:18:08 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=10281MB free_disk=25.898712158203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:18:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:18:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:18:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:19:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:19:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:19:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:19:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:09 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:19:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9592MB free_disk=25.918193817138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:19:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:19:14 user nova-compute[74131]: INFO nova.compute.claims [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Claim successful on node user
Oct 20 16:19:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:19:15 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:19:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:19:15 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Creating image(s)
Oct 20 16:19:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "/opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "/opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "/opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:15 user nova-compute[74131]: DEBUG nova.policy [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dcc4ddad51a4b988b44161b0c56c067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64918c14577b454999d913ff4275f54b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG nova.virt.images [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] 5632de9b-7b89-4624-9137-cb6ef38be112 was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.part /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.part /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.converted" returned: 0 in 0.154s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.647s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:16 user nova-compute[74131]: INFO oslo.privsep.daemon [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr3w43fdo/privsep.sock']
Oct 20 16:19:16 user sudo[83370]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr3w43fdo/privsep.sock
Oct 20 16:19:16 user sudo[83370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 16:19:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Successfully created port: 5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:19:18 user sudo[83370]: pam_unix(sudo:session): session closed for user root
Oct 20 16:19:18 user nova-compute[74131]: INFO oslo.privsep.daemon [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Spawned new privsep daemon via rootwrap
Oct 20 16:19:18 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 16:19:18 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 16:19:18 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 16:19:18 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83373
Oct 20 16:19:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.158s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk 1073741824" returned: 0 in 0.053s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Successfully updated port: 5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquired lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Cannot resize image /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Ensure instance console log exists: /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received event network-changed-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Refreshing instance network info cache due to event network-changed-5629fc1b-8b41-4636-a91e-9c735124cfd4. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:19:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] Acquiring lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Updating instance_info_cache with network_info: [{"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Releasing lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Instance network_info: |[{"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] Acquired lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.network.neutron [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Refreshing network info cache for port 5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Start _get_guest_xml network_info=[{"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:19:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-802960042',display_name='tempest-DeleteServersTestJSON-server-802960042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-802960042',id=1,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64918c14577b454999d913ff4275f54b',ramdisk_id='',reservation_id='r-f0o1fdp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1971082525',owner_user_name='tempest-DeleteServersTestJSON-1971082525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:15Z,user_data=None,user_id='4dcc4ddad51a4b988b44161b0c56c067',uuid=1889a30c-75e7-452a-b804-3dc6a2d5b2d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Converting VIF {"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:cd,bridge_name='br-int',has_traffic_filtering=True,id=5629fc1b-8b41-4636-a91e-9c735124cfd4,network=Network(27714657-d1fb-4b5e-8821-1b1c1b4ec548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5629fc1b-8b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lazy-loading 'pci_devices' on Instance uuid 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:19:20 user nova-compute[74131]:   <uuid>1889a30c-75e7-452a-b804-3dc6a2d5b2d9</uuid>
Oct 20 16:19:20 user nova-compute[74131]:   <name>instance-00000001</name>
Oct 20 16:19:20 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:19:20 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:19:20 user nova-compute[74131]:   <metadata>
Oct 20 16:19:20 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:19:20 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:19:20 user nova-compute[74131]:       <nova:name>tempest-DeleteServersTestJSON-server-802960042</nova:name>
Oct 20 16:19:20 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:19:20</nova:creationTime>
Oct 20 16:19:20 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:19:20 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:19:20 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:19:20 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:19:20 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:19:20 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:19:20 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:19:20 user nova-compute[74131]:       <nova:owner>
Oct 20 16:19:20 user nova-compute[74131]:         <nova:user uuid="4dcc4ddad51a4b988b44161b0c56c067">tempest-DeleteServersTestJSON-1971082525-project-member</nova:user>
Oct 20 16:19:20 user nova-compute[74131]:         <nova:project uuid="64918c14577b454999d913ff4275f54b">tempest-DeleteServersTestJSON-1971082525</nova:project>
Oct 20 16:19:20 user nova-compute[74131]:       </nova:owner>
Oct 20 16:19:20 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:19:20 user nova-compute[74131]:       <nova:ports>
Oct 20 16:19:20 user nova-compute[74131]:         <nova:port uuid="5629fc1b-8b41-4636-a91e-9c735124cfd4">
Oct 20 16:19:20 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:19:20 user nova-compute[74131]:         </nova:port>
Oct 20 16:19:20 user nova-compute[74131]:       </nova:ports>
Oct 20 16:19:20 user nova-compute[74131]:     </nova:instance>
Oct 20 16:19:20 user nova-compute[74131]:   </metadata>
Oct 20 16:19:20 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:19:20 user nova-compute[74131]:     <system>
Oct 20 16:19:20 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:19:20 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:19:20 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:19:20 user nova-compute[74131]:       <entry name="serial">1889a30c-75e7-452a-b804-3dc6a2d5b2d9</entry>
Oct 20 16:19:20 user nova-compute[74131]:       <entry name="uuid">1889a30c-75e7-452a-b804-3dc6a2d5b2d9</entry>
Oct 20 16:19:20 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:19:20 user nova-compute[74131]:     </system>
Oct 20 16:19:20 user nova-compute[74131]:   </sysinfo>
Oct 20 16:19:20 user nova-compute[74131]:   <os>
Oct 20 16:19:20 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:19:20 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:19:20 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:19:20 user nova-compute[74131]:   </os>
Oct 20 16:19:20 user nova-compute[74131]:   <features>
Oct 20 16:19:20 user nova-compute[74131]:     <acpi/>
Oct 20 16:19:20 user nova-compute[74131]:     <apic/>
Oct 20 16:19:20 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:19:20 user nova-compute[74131]:   </features>
Oct 20 16:19:20 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:19:20 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:19:20 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:19:20 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:19:20 user nova-compute[74131]:   </clock>
Oct 20 16:19:20 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:19:20 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:19:20 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:19:20 user nova-compute[74131]:   </cpu>
Oct 20 16:19:20 user nova-compute[74131]:   <devices>
Oct 20 16:19:20 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:19:20 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:19:20 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk"/>
Oct 20 16:19:20 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:19:20 user nova-compute[74131]:     </disk>
Oct 20 16:19:20 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:19:20 user nova-compute[74131]:       <mac address="fa:16:3e:2a:6f:cd"/>
Oct 20 16:19:20 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:20 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:19:20 user nova-compute[74131]:       <target dev="tap5629fc1b-8b"/>
Oct 20 16:19:20 user nova-compute[74131]:     </interface>
Oct 20 16:19:20 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:19:20 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/console.log" append="off"/>
Oct 20 16:19:20 user nova-compute[74131]:     </serial>
Oct 20 16:19:20 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:19:20 user nova-compute[74131]:     <video>
Oct 20 16:19:20 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:20 user nova-compute[74131]:     </video>
Oct 20 16:19:20 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:19:20 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:19:20 user nova-compute[74131]:     </rng>
Oct 20 16:19:20 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:19:20 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:19:20 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:19:20 user nova-compute[74131]:     </memballoon>
Oct 20 16:19:20 user nova-compute[74131]:   </devices>
Oct 20 16:19:20 user nova-compute[74131]: </domain>
Oct 20 16:19:20 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-802960042',display_name='tempest-DeleteServersTestJSON-server-802960042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-802960042',id=1,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64918c14577b454999d913ff4275f54b',ramdisk_id='',reservation_id='r-f0o1fdp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1971082525',owner_user_name='tempest-DeleteServersTestJSON-1971082525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:15Z,user_data=None,user_id='4dcc4ddad51a4b988b44161b0c56c067',uuid=1889a30c-75e7-452a-b804-3dc6a2d5b2d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Converting VIF {"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:cd,bridge_name='br-int',has_traffic_filtering=True,id=5629fc1b-8b41-4636-a91e-9c735124cfd4,network=Network(27714657-d1fb-4b5e-8821-1b1c1b4ec548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5629fc1b-8b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:20 user nova-compute[74131]: DEBUG os_vif [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:cd,bridge_name='br-int',has_traffic_filtering=True,id=5629fc1b-8b41-4636-a91e-9c735124cfd4,network=Network(27714657-d1fb-4b5e-8821-1b1c1b4ec548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5629fc1b-8b') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Created schema index Interface.name {{(pid=74131) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Created schema index Port.name {{(pid=74131) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Created schema index Bridge.name {{(pid=74131) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [POLLOUT] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f9b2e8c-315c-52c5-a8f7-e76380a02a87', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:21 user nova-compute[74131]: INFO oslo.privsep.daemon [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4eq588uq/privsep.sock']
Oct 20 16:19:21 user sudo[83399]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4eq588uq/privsep.sock
Oct 20 16:19:21 user sudo[83399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 16:19:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:19:21 user nova-compute[74131]: INFO nova.compute.claims [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Claim successful on node user
Oct 20 16:19:21 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:19:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:19:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:19:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:19:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Creating image(s)
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG nova.policy [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79db1d105a6e406a965eb94987fdfaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac73a0c54fb4583aec623c4c7528428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.261s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.264s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk 1073741824" returned: 0 in 0.060s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:23 user sudo[83399]: pam_unix(sudo:session): session closed for user root
Oct 20 16:19:23 user nova-compute[74131]: INFO oslo.privsep.daemon [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Spawned new privsep daemon via rootwrap
Oct 20 16:19:23 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 16:19:23 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 16:19:23 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 16:19:23 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83428
Oct 20 16:19:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Updated VIF entry in instance network info cache for port 5629fc1b-8b41-4636-a91e-9c735124cfd4. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Updating instance_info_cache with network_info: [{"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ace6379-988c-4c03-87e0-38e8ecb5767e req-1e87f4dd-399a-4c4f-8bda-f31a7648903b service nova] Releasing lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.210s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Cannot resize image /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Ensure instance console log exists: /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5629fc1b-8b, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5629fc1b-8b, col_values=(('qos', UUID('6aa7e90a-fbdf-4cfb-bd86-25d94f15ccbd')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5629fc1b-8b, col_values=(('external_ids', {'iface-id': '5629fc1b-8b41-4636-a91e-9c735124cfd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:6f:cd', 'vm-uuid': '1889a30c-75e7-452a-b804-3dc6a2d5b2d9'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:23 user nova-compute[74131]: INFO os_vif [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:cd,bridge_name='br-int',has_traffic_filtering=True,id=5629fc1b-8b41-4636-a91e-9c735124cfd4,network=Network(27714657-d1fb-4b5e-8821-1b1c1b4ec548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5629fc1b-8b')
Oct 20 16:19:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:19:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] No VIF found with MAC fa:16:3e:2a:6f:cd, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:19:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Successfully created port: f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:19:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Successfully updated port: f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquired lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:19:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Instance spawned successfully.
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-changed-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Refreshing instance network info cache due to event network-changed-f9c05f0f-9d46-4970-a524-d66c38905e0e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] Acquiring lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:19:27 user nova-compute[74131]: INFO nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Took 12.64 seconds to spawn the instance on the hypervisor.
Oct 20 16:19:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:19:28 user nova-compute[74131]: INFO nova.compute.manager [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Took 13.63 seconds to build instance.
Oct 20 16:19:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5300c1d7-2030-4745-bf7e-31a5c651dfef tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.047s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating instance_info_cache with network_info: [{"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Releasing lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Instance network_info: |[{"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] Acquired lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Refreshing network info cache for port f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Start _get_guest_xml network_info=[{"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:19:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-695004177',display_name='tempest-AttachVolumeNegativeTest-server-695004177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-695004177',id=2,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUjjfQT09wNt+FeE7pZlx0dnkQuGAl2qxXirqFl85FyC36hfFSqHMML7ux7QfNzkbTHGbz1ZdZDf6L/oayvayP5vSs6t8a0XZCvbSECXkfVoFQoIIH4tiQlSHGRyWYYMw==',key_name='tempest-keypair-1811474218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-uq9q0hpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=3e22a492-a812-415d-92c1-3cc51b842cc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0b:93,bridge_name='br-int',has_traffic_filtering=True,id=f9c05f0f-9d46-4970-a524-d66c38905e0e,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c05f0f-9d') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:19:28 user nova-compute[74131]:   <uuid>3e22a492-a812-415d-92c1-3cc51b842cc0</uuid>
Oct 20 16:19:28 user nova-compute[74131]:   <name>instance-00000002</name>
Oct 20 16:19:28 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:19:28 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:19:28 user nova-compute[74131]:   <metadata>
Oct 20 16:19:28 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:19:28 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:19:28 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeNegativeTest-server-695004177</nova:name>
Oct 20 16:19:28 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:19:28</nova:creationTime>
Oct 20 16:19:28 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:19:28 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:19:28 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:19:28 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:19:28 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:19:28 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:19:28 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:19:28 user nova-compute[74131]:       <nova:owner>
Oct 20 16:19:28 user nova-compute[74131]:         <nova:user uuid="79db1d105a6e406a965eb94987fdfaf3">tempest-AttachVolumeNegativeTest-395634699-project-member</nova:user>
Oct 20 16:19:28 user nova-compute[74131]:         <nova:project uuid="3ac73a0c54fb4583aec623c4c7528428">tempest-AttachVolumeNegativeTest-395634699</nova:project>
Oct 20 16:19:28 user nova-compute[74131]:       </nova:owner>
Oct 20 16:19:28 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:19:28 user nova-compute[74131]:       <nova:ports>
Oct 20 16:19:28 user nova-compute[74131]:         <nova:port uuid="f9c05f0f-9d46-4970-a524-d66c38905e0e">
Oct 20 16:19:28 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:19:28 user nova-compute[74131]:         </nova:port>
Oct 20 16:19:28 user nova-compute[74131]:       </nova:ports>
Oct 20 16:19:28 user nova-compute[74131]:     </nova:instance>
Oct 20 16:19:28 user nova-compute[74131]:   </metadata>
Oct 20 16:19:28 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:19:28 user nova-compute[74131]:     <system>
Oct 20 16:19:28 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:19:28 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:19:28 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:19:28 user nova-compute[74131]:       <entry name="serial">3e22a492-a812-415d-92c1-3cc51b842cc0</entry>
Oct 20 16:19:28 user nova-compute[74131]:       <entry name="uuid">3e22a492-a812-415d-92c1-3cc51b842cc0</entry>
Oct 20 16:19:28 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:19:28 user nova-compute[74131]:     </system>
Oct 20 16:19:28 user nova-compute[74131]:   </sysinfo>
Oct 20 16:19:28 user nova-compute[74131]:   <os>
Oct 20 16:19:28 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:19:28 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:19:28 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:19:28 user nova-compute[74131]:   </os>
Oct 20 16:19:28 user nova-compute[74131]:   <features>
Oct 20 16:19:28 user nova-compute[74131]:     <acpi/>
Oct 20 16:19:28 user nova-compute[74131]:     <apic/>
Oct 20 16:19:28 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:19:28 user nova-compute[74131]:   </features>
Oct 20 16:19:28 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:19:28 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:19:28 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:19:28 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:19:28 user nova-compute[74131]:   </clock>
Oct 20 16:19:28 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:19:28 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:19:28 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:19:28 user nova-compute[74131]:   </cpu>
Oct 20 16:19:28 user nova-compute[74131]:   <devices>
Oct 20 16:19:28 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:19:28 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:19:28 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk"/>
Oct 20 16:19:28 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:19:28 user nova-compute[74131]:     </disk>
Oct 20 16:19:28 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:19:28 user nova-compute[74131]:       <mac address="fa:16:3e:3b:0b:93"/>
Oct 20 16:19:28 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:28 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:19:28 user nova-compute[74131]:       <target dev="tapf9c05f0f-9d"/>
Oct 20 16:19:28 user nova-compute[74131]:     </interface>
Oct 20 16:19:28 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:19:28 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/console.log" append="off"/>
Oct 20 16:19:28 user nova-compute[74131]:     </serial>
Oct 20 16:19:28 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:19:28 user nova-compute[74131]:     <video>
Oct 20 16:19:28 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:28 user nova-compute[74131]:     </video>
Oct 20 16:19:28 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:19:28 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:19:28 user nova-compute[74131]:     </rng>
Oct 20 16:19:28 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:19:28 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:19:28 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:19:28 user nova-compute[74131]:     </memballoon>
Oct 20 16:19:28 user nova-compute[74131]:   </devices>
Oct 20 16:19:28 user nova-compute[74131]: </domain>
Oct 20 16:19:28 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-695004177',display_name='tempest-AttachVolumeNegativeTest-server-695004177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-695004177',id=2,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUjjfQT09wNt+FeE7pZlx0dnkQuGAl2qxXirqFl85FyC36hfFSqHMML7ux7QfNzkbTHGbz1ZdZDf6L/oayvayP5vSs6t8a0XZCvbSECXkfVoFQoIIH4tiQlSHGRyWYYMw==',key_name='tempest-keypair-1811474218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-uq9q0hpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=3e22a492-a812-415d-92c1-3cc51b842cc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0b:93,bridge_name='br-int',has_traffic_filtering=True,id=f9c05f0f-9d46-4970-a524-d66c38905e0e,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c05f0f-9d') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG os_vif [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0b:93,bridge_name='br-int',has_traffic_filtering=True,id=f9c05f0f-9d46-4970-a524-d66c38905e0e,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c05f0f-9d') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ab901ff-107e-590c-a3f0-08ea2a349fb9', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9c05f0f-9d, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9c05f0f-9d, col_values=(('qos', UUID('a034c3fb-f8cf-4858-81d3-041fba0d334c')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9c05f0f-9d, col_values=(('external_ids', {'iface-id': 'f9c05f0f-9d46-4970-a524-d66c38905e0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:0b:93', 'vm-uuid': '3e22a492-a812-415d-92c1-3cc51b842cc0'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:28 user nova-compute[74131]: INFO os_vif [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0b:93,bridge_name='br-int',has_traffic_filtering=True,id=f9c05f0f-9d46-4970-a524-d66c38905e0e,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c05f0f-9d')
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:19:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No VIF found with MAC fa:16:3e:3b:0b:93, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:19:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updated VIF entry in instance network info cache for port f9c05f0f-9d46-4970-a524-d66c38905e0e. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:19:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating instance_info_cache with network_info: [{"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d683001-939f-4d26-bc32-9a23338eb41a req-50881f91-2c62-419a-836a-6d4ef25661b6 service nova] Releasing lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-31d137b4-a9d4-48f4-8d4d-ccdd2479128f req-cb2c1c12-61a1-40d1-9ef2-00b3196d1ee6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31d137b4-a9d4-48f4-8d4d-ccdd2479128f req-cb2c1c12-61a1-40d1-9ef2-00b3196d1ee6 service nova] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31d137b4-a9d4-48f4-8d4d-ccdd2479128f req-cb2c1c12-61a1-40d1-9ef2-00b3196d1ee6 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31d137b4-a9d4-48f4-8d4d-ccdd2479128f req-cb2c1c12-61a1-40d1-9ef2-00b3196d1ee6 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-31d137b4-a9d4-48f4-8d4d-ccdd2479128f req-cb2c1c12-61a1-40d1-9ef2-00b3196d1ee6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] No waiting events found dispatching network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:19:31 user nova-compute[74131]: WARNING nova.compute.manager [req-31d137b4-a9d4-48f4-8d4d-ccdd2479128f req-cb2c1c12-61a1-40d1-9ef2-00b3196d1ee6 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received unexpected event network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e for instance with vm_state building and task_state spawning.
Oct 20 16:19:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:19:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Instance spawned successfully.
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:33 user nova-compute[74131]: INFO nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Took 10.81 seconds to spawn the instance on the hypervisor.
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c8958f4-75e4-4215-ac0b-a90c7657019b req-c548c953-6bc7-443d-bfdd-7581397211d8 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c8958f4-75e4-4215-ac0b-a90c7657019b req-c548c953-6bc7-443d-bfdd-7581397211d8 service nova] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c8958f4-75e4-4215-ac0b-a90c7657019b req-c548c953-6bc7-443d-bfdd-7581397211d8 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c8958f4-75e4-4215-ac0b-a90c7657019b req-c548c953-6bc7-443d-bfdd-7581397211d8 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c8958f4-75e4-4215-ac0b-a90c7657019b req-c548c953-6bc7-443d-bfdd-7581397211d8 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] No waiting events found dispatching network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:19:33 user nova-compute[74131]: WARNING nova.compute.manager [req-3c8958f4-75e4-4215-ac0b-a90c7657019b req-c548c953-6bc7-443d-bfdd-7581397211d8 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received unexpected event network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e for instance with vm_state building and task_state spawning.
Oct 20 16:19:33 user nova-compute[74131]: INFO nova.compute.manager [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Took 12.01 seconds to build instance.
Oct 20 16:19:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4e98d05b-4ea5-4dc1-9ef5-918b228d0f65 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.211s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-07caca08-5a84-4254-a7ce-cad8709390e1 req-3f4bdcae-759c-4321-9275-505e2778f6c1 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received event network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07caca08-5a84-4254-a7ce-cad8709390e1 req-3f4bdcae-759c-4321-9275-505e2778f6c1 service nova] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07caca08-5a84-4254-a7ce-cad8709390e1 req-3f4bdcae-759c-4321-9275-505e2778f6c1 service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07caca08-5a84-4254-a7ce-cad8709390e1 req-3f4bdcae-759c-4321-9275-505e2778f6c1 service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-07caca08-5a84-4254-a7ce-cad8709390e1 req-3f4bdcae-759c-4321-9275-505e2778f6c1 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] No waiting events found dispatching network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:19:36 user nova-compute[74131]: WARNING nova.compute.manager [req-07caca08-5a84-4254-a7ce-cad8709390e1 req-3f4bdcae-759c-4321-9275-505e2778f6c1 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received unexpected event network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 for instance with vm_state active and task_state None.
Oct 20 16:19:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-808a378a-9ea1-48d8-8c88-0c4a7a161f45 req-4b12fa18-8a12-4e4c-971a-b8f3ed895063 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received event network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-808a378a-9ea1-48d8-8c88-0c4a7a161f45 req-4b12fa18-8a12-4e4c-971a-b8f3ed895063 service nova] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-808a378a-9ea1-48d8-8c88-0c4a7a161f45 req-4b12fa18-8a12-4e4c-971a-b8f3ed895063 service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-808a378a-9ea1-48d8-8c88-0c4a7a161f45 req-4b12fa18-8a12-4e4c-971a-b8f3ed895063 service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-808a378a-9ea1-48d8-8c88-0c4a7a161f45 req-4b12fa18-8a12-4e4c-971a-b8f3ed895063 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] No waiting events found dispatching network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:19:38 user nova-compute[74131]: WARNING nova.compute.manager [req-808a378a-9ea1-48d8-8c88-0c4a7a161f45 req-4b12fa18-8a12-4e4c-971a-b8f3ed895063 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received unexpected event network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 for instance with vm_state active and task_state None.
Oct 20 16:19:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:19:44 user nova-compute[74131]: INFO nova.compute.claims [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Claim successful on node user
Oct 20 16:19:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:19:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.policy [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '746522fa663e452a8dc8e027d4ada53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130aaa9f8cfd4f4da3ea514336679ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:19:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Creating image(s)
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.008s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.224s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk 1073741824" returned: 0 in 0.054s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.246s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Successfully created port: 846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Cannot resize image /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Ensure instance console log exists: /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Successfully updated port: 846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquired lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-changed-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Refreshing instance network info cache due to event network-changed-846a2357-b301-40b9-8bca-d3b22e092a24. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] Acquiring lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Releasing lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Instance network_info: |[{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] Acquired lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.neutron [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Refreshing network info cache for port 846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Start _get_guest_xml network_info=[{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:19:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converting VIF {"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:40:bb,bridge_name='br-int',has_traffic_filtering=True,id=846a2357-b301-40b9-8bca-d3b22e092a24,network=Network(90cba9ff-7022-4987-9e13-0dff5c85a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap846a2357-b3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'pci_devices' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:19:46 user nova-compute[74131]:   <uuid>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</uuid>
Oct 20 16:19:46 user nova-compute[74131]:   <name>instance-00000003</name>
Oct 20 16:19:46 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:19:46 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:19:46 user nova-compute[74131]:   <metadata>
Oct 20 16:19:46 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:19:46 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:19:46 user nova-compute[74131]:       <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:19:46 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:19:46</nova:creationTime>
Oct 20 16:19:46 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:19:46 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:19:46 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:19:46 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:19:46 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:19:46 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:19:46 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:19:46 user nova-compute[74131]:       <nova:owner>
Oct 20 16:19:46 user nova-compute[74131]:         <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:19:46 user nova-compute[74131]:         <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:19:46 user nova-compute[74131]:       </nova:owner>
Oct 20 16:19:46 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:19:46 user nova-compute[74131]:       <nova:ports>
Oct 20 16:19:46 user nova-compute[74131]:         <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:19:46 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:19:46 user nova-compute[74131]:         </nova:port>
Oct 20 16:19:46 user nova-compute[74131]:       </nova:ports>
Oct 20 16:19:46 user nova-compute[74131]:     </nova:instance>
Oct 20 16:19:46 user nova-compute[74131]:   </metadata>
Oct 20 16:19:46 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:19:46 user nova-compute[74131]:     <system>
Oct 20 16:19:46 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:19:46 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:19:46 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:19:46 user nova-compute[74131]:       <entry name="serial">ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:19:46 user nova-compute[74131]:       <entry name="uuid">ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:19:46 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:19:46 user nova-compute[74131]:     </system>
Oct 20 16:19:46 user nova-compute[74131]:   </sysinfo>
Oct 20 16:19:46 user nova-compute[74131]:   <os>
Oct 20 16:19:46 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:19:46 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:19:46 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:19:46 user nova-compute[74131]:   </os>
Oct 20 16:19:46 user nova-compute[74131]:   <features>
Oct 20 16:19:46 user nova-compute[74131]:     <acpi/>
Oct 20 16:19:46 user nova-compute[74131]:     <apic/>
Oct 20 16:19:46 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:19:46 user nova-compute[74131]:   </features>
Oct 20 16:19:46 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:19:46 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:19:46 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:19:46 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:19:46 user nova-compute[74131]:   </clock>
Oct 20 16:19:46 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:19:46 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:19:46 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:19:46 user nova-compute[74131]:   </cpu>
Oct 20 16:19:46 user nova-compute[74131]:   <devices>
Oct 20 16:19:46 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:19:46 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:19:46 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk"/>
Oct 20 16:19:46 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:19:46 user nova-compute[74131]:     </disk>
Oct 20 16:19:46 user nova-compute[74131]:     <disk type="file" device="cdrom">
Oct 20 16:19:46 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 16:19:46 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config"/>
Oct 20 16:19:46 user nova-compute[74131]:       <target dev="hda" bus="ide"/>
Oct 20 16:19:46 user nova-compute[74131]:     </disk>
Oct 20 16:19:46 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:19:46 user nova-compute[74131]:       <mac address="fa:16:3e:7f:40:bb"/>
Oct 20 16:19:46 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:46 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:19:46 user nova-compute[74131]:       <target dev="tap846a2357-b3"/>
Oct 20 16:19:46 user nova-compute[74131]:     </interface>
Oct 20 16:19:46 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:19:46 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log" append="off"/>
Oct 20 16:19:46 user nova-compute[74131]:     </serial>
Oct 20 16:19:46 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:19:46 user nova-compute[74131]:     <video>
Oct 20 16:19:46 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:46 user nova-compute[74131]:     </video>
Oct 20 16:19:46 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:19:46 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:19:46 user nova-compute[74131]:     </rng>
Oct 20 16:19:46 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:19:46 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:19:46 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:19:46 user nova-compute[74131]:     </memballoon>
Oct 20 16:19:46 user nova-compute[74131]:   </devices>
Oct 20 16:19:46 user nova-compute[74131]: </domain>
Oct 20 16:19:46 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converting VIF {"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:40:bb,bridge_name='br-int',has_traffic_filtering=True,id=846a2357-b301-40b9-8bca-d3b22e092a24,network=Network(90cba9ff-7022-4987-9e13-0dff5c85a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap846a2357-b3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG os_vif [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:40:bb,bridge_name='br-int',has_traffic_filtering=True,id=846a2357-b301-40b9-8bca-d3b22e092a24,network=Network(90cba9ff-7022-4987-9e13-0dff5c85a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap846a2357-b3') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b459fe5d-d366-5129-bd58-33b6d773b6c0', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap846a2357-b3, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap846a2357-b3, col_values=(('qos', UUID('23f49543-72f1-47a5-b35a-0a08768c0088')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap846a2357-b3, col_values=(('external_ids', {'iface-id': '846a2357-b301-40b9-8bca-d3b22e092a24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:40:bb', 'vm-uuid': 'ee67f6fa-6b81-46b5-a3cc-ef756c0ad477'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:46 user nova-compute[74131]: INFO os_vif [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:40:bb,bridge_name='br-int',has_traffic_filtering=True,id=846a2357-b301-40b9-8bca-d3b22e092a24,network=Network(90cba9ff-7022-4987-9e13-0dff5c85a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap846a2357-b3')
Oct 20 16:19:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No BDM found with device name hda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:19:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No VIF found with MAC fa:16:3e:7f:40:bb, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:19:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Using config drive
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:19:47 user nova-compute[74131]: INFO nova.compute.claims [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Claim successful on node user
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updated VIF entry in instance network info cache for port 846a2357-b301-40b9-8bca-d3b22e092a24. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-482238b8-f576-47cd-b001-5453410228de req-effeca50-da82-43c6-8de0-3b012584c9b0 service nova] Releasing lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Creating config drive at /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiokai_ak {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiokai_ak" returned: 0 in 0.060s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.network.neutron [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:19:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.policy [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68d1d7d4655344bfbb847f91efacdcc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06df2eb0ad246c89ccdc5255b2bbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:19:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Creating image(s)
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "/opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "/opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "/opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "fe465a7fac4b0aac4951fd525532f5ead78e5517" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "fe465a7fac4b0aac4951fd525532f5ead78e5517" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.part --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG nova.virt.images [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] 1be36b44-f88f-447d-b3da-c47f6f2af025 was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.part /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG nova.network.neutron [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Successfully created port: 7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.part /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.converted" returned: 0 in 0.140s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "fe465a7fac4b0aac4951fd525532f5ead78e5517" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.928s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517 --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "fe465a7fac4b0aac4951fd525532f5ead78e5517" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "fe465a7fac4b0aac4951fd525532f5ead78e5517" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517 --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517,backing_fmt=raw /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Successfully updated port: 7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517,backing_fmt=raw /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk 1073741824" returned: 0 in 0.061s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "fe465a7fac4b0aac4951fd525532f5ead78e5517" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquired lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-changed-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Refreshing instance network info cache due to event network-changed-7b9444f6-ea43-4322-9c80-b9d7988f8f5b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] Acquiring lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517 --force-share --output=json" returned: 0 in 0.230s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Cannot resize image /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Ensure instance console log exists: /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updating instance_info_cache with network_info: [{"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Releasing lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Instance network_info: |[{"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] Acquired lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.network.neutron [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Refreshing network info cache for port 7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Start _get_guest_xml network_info=[{"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:19:40Z,direct_url=<?>,disk_format='qcow2',id=1be36b44-f88f-447d-b3da-c47f6f2af025,min_disk=0,min_ram=0,name='',owner='08c747a7b0ce48a184e381169eec7b1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:19:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'disk_bus': 'scsi', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '1be36b44-f88f-447d-b3da-c47f6f2af025'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:19:49 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:49 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:19:40Z,direct_url=<?>,disk_format='qcow2',id=1be36b44-f88f-447d-b3da-c47f6f2af025,min_disk=0,min_ram=0,name='',owner='08c747a7b0ce48a184e381169eec7b1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:19:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1996108091',display_name='tempest-AttachSCSIVolumeTestJSON-server-1996108091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1996108091',id=4,image_ref='1be36b44-f88f-447d-b3da-c47f6f2af025',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJHSimtLxbgzGVf8hp0z6ie+dPIdGSTyoHvt3z2T6yV3upJWRjTgXyTi8w7EhLesNSjpGhrwnzTwKlkfC9i2hGxzzdDsgeIjuoslBXaaNG3KsIEEs40nw9q8thhNgI4Vw==',key_name='tempest-keypair-1819596975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06df2eb0ad246c89ccdc5255b2bbdd6',ramdisk_id='',reservation_id='r-6p1ope3u',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1be36b44-f88f-447d-b3da-c47f6f2af025',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-250285697',owner_user_name='tempest-AttachSCSIVolumeTestJSON-250285697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d1d7d4655344bfbb847f91efacdcc2',uuid=eea7c78b-928f-4e65-956a-cb57026ef891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Converting VIF {"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:a3:09,bridge_name='br-int',has_traffic_filtering=True,id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b,network=Network(ee41fac1-3f2e-4c40-aad3-2d9eecad539a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9444f6-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lazy-loading 'pci_devices' on Instance uuid eea7c78b-928f-4e65-956a-cb57026ef891 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:19:50 user nova-compute[74131]:   <uuid>eea7c78b-928f-4e65-956a-cb57026ef891</uuid>
Oct 20 16:19:50 user nova-compute[74131]:   <name>instance-00000004</name>
Oct 20 16:19:50 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:19:50 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:19:50 user nova-compute[74131]:   <metadata>
Oct 20 16:19:50 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:19:50 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:19:50 user nova-compute[74131]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1996108091</nova:name>
Oct 20 16:19:50 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:19:49</nova:creationTime>
Oct 20 16:19:50 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:19:50 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:19:50 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:19:50 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:19:50 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:19:50 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:19:50 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:19:50 user nova-compute[74131]:       <nova:owner>
Oct 20 16:19:50 user nova-compute[74131]:         <nova:user uuid="68d1d7d4655344bfbb847f91efacdcc2">tempest-AttachSCSIVolumeTestJSON-250285697-project-member</nova:user>
Oct 20 16:19:50 user nova-compute[74131]:         <nova:project uuid="d06df2eb0ad246c89ccdc5255b2bbdd6">tempest-AttachSCSIVolumeTestJSON-250285697</nova:project>
Oct 20 16:19:50 user nova-compute[74131]:       </nova:owner>
Oct 20 16:19:50 user nova-compute[74131]:       <nova:root type="image" uuid="1be36b44-f88f-447d-b3da-c47f6f2af025"/>
Oct 20 16:19:50 user nova-compute[74131]:       <nova:ports>
Oct 20 16:19:50 user nova-compute[74131]:         <nova:port uuid="7b9444f6-ea43-4322-9c80-b9d7988f8f5b">
Oct 20 16:19:50 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 16:19:50 user nova-compute[74131]:         </nova:port>
Oct 20 16:19:50 user nova-compute[74131]:       </nova:ports>
Oct 20 16:19:50 user nova-compute[74131]:     </nova:instance>
Oct 20 16:19:50 user nova-compute[74131]:   </metadata>
Oct 20 16:19:50 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:19:50 user nova-compute[74131]:     <system>
Oct 20 16:19:50 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:19:50 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:19:50 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:19:50 user nova-compute[74131]:       <entry name="serial">eea7c78b-928f-4e65-956a-cb57026ef891</entry>
Oct 20 16:19:50 user nova-compute[74131]:       <entry name="uuid">eea7c78b-928f-4e65-956a-cb57026ef891</entry>
Oct 20 16:19:50 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:19:50 user nova-compute[74131]:     </system>
Oct 20 16:19:50 user nova-compute[74131]:   </sysinfo>
Oct 20 16:19:50 user nova-compute[74131]:   <os>
Oct 20 16:19:50 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:19:50 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:19:50 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:19:50 user nova-compute[74131]:   </os>
Oct 20 16:19:50 user nova-compute[74131]:   <features>
Oct 20 16:19:50 user nova-compute[74131]:     <acpi/>
Oct 20 16:19:50 user nova-compute[74131]:     <apic/>
Oct 20 16:19:50 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:19:50 user nova-compute[74131]:   </features>
Oct 20 16:19:50 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:19:50 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:19:50 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:19:50 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:19:50 user nova-compute[74131]:   </clock>
Oct 20 16:19:50 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:19:50 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:19:50 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:19:50 user nova-compute[74131]:   </cpu>
Oct 20 16:19:50 user nova-compute[74131]:   <devices>
Oct 20 16:19:50 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:19:50 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:19:50 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk"/>
Oct 20 16:19:50 user nova-compute[74131]:       <target dev="sda" bus="scsi"/>
Oct 20 16:19:50 user nova-compute[74131]:       <address type="drive" controller="0" unit="0"/>
Oct 20 16:19:50 user nova-compute[74131]:     </disk>
Oct 20 16:19:50 user nova-compute[74131]:     <disk type="file" device="cdrom">
Oct 20 16:19:50 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 16:19:50 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk.config"/>
Oct 20 16:19:50 user nova-compute[74131]:       <target dev="sdb" bus="scsi"/>
Oct 20 16:19:50 user nova-compute[74131]:       <address type="drive" controller="0" unit="1"/>
Oct 20 16:19:50 user nova-compute[74131]:     </disk>
Oct 20 16:19:50 user nova-compute[74131]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 16:19:50 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:19:50 user nova-compute[74131]:       <mac address="fa:16:3e:19:a3:09"/>
Oct 20 16:19:50 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:50 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:19:50 user nova-compute[74131]:       <target dev="tap7b9444f6-ea"/>
Oct 20 16:19:50 user nova-compute[74131]:     </interface>
Oct 20 16:19:50 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:19:50 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/console.log" append="off"/>
Oct 20 16:19:50 user nova-compute[74131]:     </serial>
Oct 20 16:19:50 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:19:50 user nova-compute[74131]:     <video>
Oct 20 16:19:50 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:50 user nova-compute[74131]:     </video>
Oct 20 16:19:50 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:19:50 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:19:50 user nova-compute[74131]:     </rng>
Oct 20 16:19:50 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:19:50 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:19:50 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:19:50 user nova-compute[74131]:     </memballoon>
Oct 20 16:19:50 user nova-compute[74131]:   </devices>
Oct 20 16:19:50 user nova-compute[74131]: </domain>
Oct 20 16:19:50 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1996108091',display_name='tempest-AttachSCSIVolumeTestJSON-server-1996108091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1996108091',id=4,image_ref='1be36b44-f88f-447d-b3da-c47f6f2af025',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJHSimtLxbgzGVf8hp0z6ie+dPIdGSTyoHvt3z2T6yV3upJWRjTgXyTi8w7EhLesNSjpGhrwnzTwKlkfC9i2hGxzzdDsgeIjuoslBXaaNG3KsIEEs40nw9q8thhNgI4Vw==',key_name='tempest-keypair-1819596975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06df2eb0ad246c89ccdc5255b2bbdd6',ramdisk_id='',reservation_id='r-6p1ope3u',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1be36b44-f88f-447d-b3da-c47f6f2af025',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-250285697',owner_user_name='tempest-AttachSCSIVolumeTestJSON-250285697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d1d7d4655344bfbb847f91efacdcc2',uuid=eea7c78b-928f-4e65-956a-cb57026ef891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Converting VIF {"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:a3:09,bridge_name='br-int',has_traffic_filtering=True,id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b,network=Network(ee41fac1-3f2e-4c40-aad3-2d9eecad539a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9444f6-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG os_vif [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a3:09,bridge_name='br-int',has_traffic_filtering=True,id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b,network=Network(ee41fac1-3f2e-4c40-aad3-2d9eecad539a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9444f6-ea') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c00d10b7-bb15-5a6f-b1ab-1cf36ed5cc5d', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b9444f6-ea, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b9444f6-ea, col_values=(('qos', UUID('86a04f94-7466-45f9-88d0-bd7e2c6fc85e')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b9444f6-ea, col_values=(('external_ids', {'iface-id': '7b9444f6-ea43-4322-9c80-b9d7988f8f5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:a3:09', 'vm-uuid': 'eea7c78b-928f-4e65-956a-cb57026ef891'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:50 user nova-compute[74131]: INFO os_vif [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a3:09,bridge_name='br-int',has_traffic_filtering=True,id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b,network=Network(ee41fac1-3f2e-4c40-aad3-2d9eecad539a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9444f6-ea')
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] No BDM found with device name sda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] No VIF found with MAC fa:16:3e:19:a3:09, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:19:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Using config drive
Oct 20 16:19:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Creating config drive at /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk.config
Oct 20 16:19:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt17l8c9j {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.network.neutron [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updated VIF entry in instance network info cache for port 7b9444f6-ea43-4322-9c80-b9d7988f8f5b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG nova.network.neutron [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updating instance_info_cache with network_info: [{"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt17l8c9j" returned: 0 in 0.059s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62fde5c6-0d29-4165-a59b-937fe4d27e67 req-9b2ffa7d-3c0a-4db0-bcb7-d17f7da852b6 service nova] Releasing lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:19:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Instance spawned successfully.
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:51 user nova-compute[74131]: INFO nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Took 6.72 seconds to spawn the instance on the hypervisor.
Oct 20 16:19:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:19:51 user nova-compute[74131]: INFO nova.compute.manager [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Took 7.58 seconds to build instance.
Oct 20 16:19:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5e9129d-30a8-4621-9699-e5dfe993b84e tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.743s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-bbc739e6-65cb-4877-9cf9-c5e20c06b7d4 req-e73c7eb6-4e12-4224-a049-26509fd12192 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bbc739e6-65cb-4877-9cf9-c5e20c06b7d4 req-e73c7eb6-4e12-4224-a049-26509fd12192 service nova] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bbc739e6-65cb-4877-9cf9-c5e20c06b7d4 req-e73c7eb6-4e12-4224-a049-26509fd12192 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bbc739e6-65cb-4877-9cf9-c5e20c06b7d4 req-e73c7eb6-4e12-4224-a049-26509fd12192 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-bbc739e6-65cb-4877-9cf9-c5e20c06b7d4 req-e73c7eb6-4e12-4224-a049-26509fd12192 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] No waiting events found dispatching network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:19:52 user nova-compute[74131]: WARNING nova.compute.manager [req-bbc739e6-65cb-4877-9cf9-c5e20c06b7d4 req-e73c7eb6-4e12-4224-a049-26509fd12192 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received unexpected event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b for instance with vm_state building and task_state spawning.
Oct 20 16:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:19:54 user nova-compute[74131]: INFO nova.compute.claims [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Claim successful on node user
Oct 20 16:19:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:19:54 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.policy [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca7fd49bd6b145b1a93885cf21e51a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fa4fbd88d4bf7b181c1857dcd37f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-d3b0ebc6-340a-4b48-b44a-0c5b2b495b2e req-f3c14df2-2560-4eb0-9b6e-954bba6dfa10 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d3b0ebc6-340a-4b48-b44a-0c5b2b495b2e req-f3c14df2-2560-4eb0-9b6e-954bba6dfa10 service nova] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d3b0ebc6-340a-4b48-b44a-0c5b2b495b2e req-f3c14df2-2560-4eb0-9b6e-954bba6dfa10 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d3b0ebc6-340a-4b48-b44a-0c5b2b495b2e req-f3c14df2-2560-4eb0-9b6e-954bba6dfa10 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-d3b0ebc6-340a-4b48-b44a-0c5b2b495b2e req-f3c14df2-2560-4eb0-9b6e-954bba6dfa10 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] No waiting events found dispatching network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:19:54 user nova-compute[74131]: WARNING nova.compute.manager [req-d3b0ebc6-340a-4b48-b44a-0c5b2b495b2e req-f3c14df2-2560-4eb0-9b6e-954bba6dfa10 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received unexpected event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b for instance with vm_state building and task_state spawning.
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:19:54 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Creating image(s)
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "/opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "/opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.244s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:19:55 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Instance spawned successfully.
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.270s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:55 user nova-compute[74131]: INFO nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Took 7.39 seconds to spawn the instance on the hypervisor.
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk 1073741824" returned: 0 in 0.067s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:55 user nova-compute[74131]: INFO nova.compute.manager [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Took 8.57 seconds to build instance.
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Successfully created port: 08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.245s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-73762ff1-328d-4295-b2f7-0f28eb831816 tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.770s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Cannot resize image /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Ensure instance console log exists: /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Successfully updated port: 08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquired lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-changed-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Refreshing instance network info cache due to event network-changed-08dbda12-aa82-450d-abd5-87e218a4bc78. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] Acquiring lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:19:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updating instance_info_cache with network_info: [{"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Releasing lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Instance network_info: |[{"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] Acquired lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Refreshing network info cache for port 08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Start _get_guest_xml network_info=[{"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:19:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1490444509',display_name='tempest-TestVolumeSwap-server-1490444509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1490444509',id=5,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ0Dbgyd6beU9QjokskqLW++QqkggxyK+gUfd/3nbNJSbHCXitnZK0FSBWwVia8v2g8oYNjByAFfnLrIRVeEF93yObN7E8q8d1P672Rt7hos1oJiVuHCKIF7S13MIh7FQ==',key_name='tempest-keypair-1723633253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d31fa4fbd88d4bf7b181c1857dcd37f5',ramdisk_id='',reservation_id='r-a2u7t0w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1520187436',owner_user_name='tempest-TestVolumeSwap-1520187436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca7fd49bd6b145b1a93885cf21e51a87',uuid=a6f5e776-329d-4e3c-a18c-ca4a01789def,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Converting VIF {"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:6d:2f,bridge_name='br-int',has_traffic_filtering=True,id=08dbda12-aa82-450d-abd5-87e218a4bc78,network=Network(7966b52a-203b-474c-8214-b83f4baa4ba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08dbda12-aa') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.objects.instance [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lazy-loading 'pci_devices' on Instance uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:19:57 user nova-compute[74131]:   <uuid>a6f5e776-329d-4e3c-a18c-ca4a01789def</uuid>
Oct 20 16:19:57 user nova-compute[74131]:   <name>instance-00000005</name>
Oct 20 16:19:57 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:19:57 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:19:57 user nova-compute[74131]:   <metadata>
Oct 20 16:19:57 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:19:57 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:19:57 user nova-compute[74131]:       <nova:name>tempest-TestVolumeSwap-server-1490444509</nova:name>
Oct 20 16:19:57 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:19:57</nova:creationTime>
Oct 20 16:19:57 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:19:57 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:19:57 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:19:57 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:19:57 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:19:57 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:19:57 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:19:57 user nova-compute[74131]:       <nova:owner>
Oct 20 16:19:57 user nova-compute[74131]:         <nova:user uuid="ca7fd49bd6b145b1a93885cf21e51a87">tempest-TestVolumeSwap-1520187436-project-member</nova:user>
Oct 20 16:19:57 user nova-compute[74131]:         <nova:project uuid="d31fa4fbd88d4bf7b181c1857dcd37f5">tempest-TestVolumeSwap-1520187436</nova:project>
Oct 20 16:19:57 user nova-compute[74131]:       </nova:owner>
Oct 20 16:19:57 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:19:57 user nova-compute[74131]:       <nova:ports>
Oct 20 16:19:57 user nova-compute[74131]:         <nova:port uuid="08dbda12-aa82-450d-abd5-87e218a4bc78">
Oct 20 16:19:57 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:19:57 user nova-compute[74131]:         </nova:port>
Oct 20 16:19:57 user nova-compute[74131]:       </nova:ports>
Oct 20 16:19:57 user nova-compute[74131]:     </nova:instance>
Oct 20 16:19:57 user nova-compute[74131]:   </metadata>
Oct 20 16:19:57 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:19:57 user nova-compute[74131]:     <system>
Oct 20 16:19:57 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:19:57 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:19:57 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:19:57 user nova-compute[74131]:       <entry name="serial">a6f5e776-329d-4e3c-a18c-ca4a01789def</entry>
Oct 20 16:19:57 user nova-compute[74131]:       <entry name="uuid">a6f5e776-329d-4e3c-a18c-ca4a01789def</entry>
Oct 20 16:19:57 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:19:57 user nova-compute[74131]:     </system>
Oct 20 16:19:57 user nova-compute[74131]:   </sysinfo>
Oct 20 16:19:57 user nova-compute[74131]:   <os>
Oct 20 16:19:57 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:19:57 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:19:57 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:19:57 user nova-compute[74131]:   </os>
Oct 20 16:19:57 user nova-compute[74131]:   <features>
Oct 20 16:19:57 user nova-compute[74131]:     <acpi/>
Oct 20 16:19:57 user nova-compute[74131]:     <apic/>
Oct 20 16:19:57 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:19:57 user nova-compute[74131]:   </features>
Oct 20 16:19:57 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:19:57 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:19:57 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:19:57 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:19:57 user nova-compute[74131]:   </clock>
Oct 20 16:19:57 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:19:57 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:19:57 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:19:57 user nova-compute[74131]:   </cpu>
Oct 20 16:19:57 user nova-compute[74131]:   <devices>
Oct 20 16:19:57 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:19:57 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:19:57 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk"/>
Oct 20 16:19:57 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:19:57 user nova-compute[74131]:     </disk>
Oct 20 16:19:57 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:19:57 user nova-compute[74131]:       <mac address="fa:16:3e:ab:6d:2f"/>
Oct 20 16:19:57 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:57 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:19:57 user nova-compute[74131]:       <target dev="tap08dbda12-aa"/>
Oct 20 16:19:57 user nova-compute[74131]:     </interface>
Oct 20 16:19:57 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:19:57 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/console.log" append="off"/>
Oct 20 16:19:57 user nova-compute[74131]:     </serial>
Oct 20 16:19:57 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:19:57 user nova-compute[74131]:     <video>
Oct 20 16:19:57 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:19:57 user nova-compute[74131]:     </video>
Oct 20 16:19:57 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:19:57 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:19:57 user nova-compute[74131]:     </rng>
Oct 20 16:19:57 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:19:57 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:19:57 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:19:57 user nova-compute[74131]:     </memballoon>
Oct 20 16:19:57 user nova-compute[74131]:   </devices>
Oct 20 16:19:57 user nova-compute[74131]: </domain>
Oct 20 16:19:57 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1490444509',display_name='tempest-TestVolumeSwap-server-1490444509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1490444509',id=5,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ0Dbgyd6beU9QjokskqLW++QqkggxyK+gUfd/3nbNJSbHCXitnZK0FSBWwVia8v2g8oYNjByAFfnLrIRVeEF93yObN7E8q8d1P672Rt7hos1oJiVuHCKIF7S13MIh7FQ==',key_name='tempest-keypair-1723633253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d31fa4fbd88d4bf7b181c1857dcd37f5',ramdisk_id='',reservation_id='r-a2u7t0w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1520187436',owner_user_name='tempest-TestVolumeSwap-1520187436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca7fd49bd6b145b1a93885cf21e51a87',uuid=a6f5e776-329d-4e3c-a18c-ca4a01789def,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Converting VIF {"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:6d:2f,bridge_name='br-int',has_traffic_filtering=True,id=08dbda12-aa82-450d-abd5-87e218a4bc78,network=Network(7966b52a-203b-474c-8214-b83f4baa4ba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08dbda12-aa') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG os_vif [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:6d:2f,bridge_name='br-int',has_traffic_filtering=True,id=08dbda12-aa82-450d-abd5-87e218a4bc78,network=Network(7966b52a-203b-474c-8214-b83f4baa4ba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08dbda12-aa') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e80a06f4-64c7-56a4-b4ae-522c79d68486', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08dbda12-aa, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08dbda12-aa, col_values=(('qos', UUID('aeba35d2-d1fb-404a-88df-6825667689a8')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08dbda12-aa, col_values=(('external_ids', {'iface-id': '08dbda12-aa82-450d-abd5-87e218a4bc78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:6d:2f', 'vm-uuid': 'a6f5e776-329d-4e3c-a18c-ca4a01789def'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:57 user nova-compute[74131]: INFO os_vif [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:6d:2f,bridge_name='br-int',has_traffic_filtering=True,id=08dbda12-aa82-450d-abd5-87e218a4bc78,network=Network(7966b52a-203b-474c-8214-b83f4baa4ba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08dbda12-aa')
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] No VIF found with MAC fa:16:3e:ab:6d:2f, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updated VIF entry in instance network info cache for port 08dbda12-aa82-450d-abd5-87e218a4bc78. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updating instance_info_cache with network_info: [{"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:19:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-986a69fd-bdfd-4e69-8ded-bb27f3540edd req-ec5e827f-0ca8-4ce7-bf42-5001ee0da0e5 service nova] Releasing lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:19:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-62ee6c8d-c386-4766-bcb9-c256e7144db2 req-bca15914-1c03-4c95-9cb7-97457c6e0f2c service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62ee6c8d-c386-4766-bcb9-c256e7144db2 req-bca15914-1c03-4c95-9cb7-97457c6e0f2c service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62ee6c8d-c386-4766-bcb9-c256e7144db2 req-bca15914-1c03-4c95-9cb7-97457c6e0f2c service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62ee6c8d-c386-4766-bcb9-c256e7144db2 req-bca15914-1c03-4c95-9cb7-97457c6e0f2c service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-62ee6c8d-c386-4766-bcb9-c256e7144db2 req-bca15914-1c03-4c95-9cb7-97457c6e0f2c service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:19:59 user nova-compute[74131]: WARNING nova.compute.manager [req-62ee6c8d-c386-4766-bcb9-c256e7144db2 req-bca15914-1c03-4c95-9cb7-97457c6e0f2c service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received unexpected event network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 for instance with vm_state active and task_state None.
Oct 20 16:19:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:19:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:20:01 user nova-compute[74131]: INFO nova.compute.claims [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Claim successful on node user
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:01 user nova-compute[74131]: WARNING nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received unexpected event network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 for instance with vm_state active and task_state None.
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] No waiting events found dispatching network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:01 user nova-compute[74131]: WARNING nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received unexpected event network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 for instance with vm_state building and task_state spawning.
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] No waiting events found dispatching network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:01 user nova-compute[74131]: WARNING nova.compute.manager [req-7002beb8-6f6f-49c4-bd46-00a3baabe474 req-47de8fa5-1662-4952-a84e-cd3d5c7978fa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received unexpected event network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 for instance with vm_state building and task_state spawning.
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:20:01 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Instance spawned successfully.
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:20:01 user nova-compute[74131]: INFO nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Took 7.10 seconds to spawn the instance on the hypervisor.
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.network.neutron [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:20:01 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:20:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:20:01 user nova-compute[74131]: INFO nova.compute.manager [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Took 7.97 seconds to build instance.
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8b86a197-2f3c-40c3-b9e6-25b1700913d7 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.310s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG nova.policy [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5b50ea489fb4e1b85431adc0fadff01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ab47cdc124a01b239914da533b04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:20:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Creating image(s)
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "/opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "/opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.267s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.266s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk 1073741824" returned: 0 in 0.058s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Successfully created port: 29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.281s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Cannot resize image /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Ensure instance console log exists: /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Successfully updated port: 29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquired lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-changed-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Refreshing instance network info cache due to event network-changed-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] Acquiring lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:20:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Updating instance_info_cache with network_info: [{"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Releasing lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Instance network_info: |[{"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] Acquired lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Refreshing network info cache for port 29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Start _get_guest_xml network_info=[{"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:20:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1984275987',display_name='tempest-VolumesAssistedSnapshotsTest-server-1984275987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1984275987',id=6,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrLc7dXT9RmL73/GdWei1ZnbVpp2GjoEY+RO3cx1rPc5dD/9basloB4UUuv7CcFlRo3G7zLjhHhGndHDE8Qh2B24mzv6WY7MdKiyYxGwGesKcBAUNh3RNYYJj9MNkol/Q==',key_name='tempest-keypair-1653230815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6ab47cdc124a01b239914da533b04a',ramdisk_id='',reservation_id='r-mk30bsg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-59096444',owner_user_name='tempest-VolumesAssistedSnapshotsTest-59096444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5b50ea489fb4e1b85431adc0fadff01',uuid=fe867561-330e-4ccd-a012-46d4420bcbaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Converting VIF {"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d0:fc,bridge_name='br-int',has_traffic_filtering=True,id=29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3,network=Network(baab4a05-0596-4ada-8bba-a3deae96c806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ea0f22-8e') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lazy-loading 'pci_devices' on Instance uuid fe867561-330e-4ccd-a012-46d4420bcbaf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:20:04 user nova-compute[74131]:   <uuid>fe867561-330e-4ccd-a012-46d4420bcbaf</uuid>
Oct 20 16:20:04 user nova-compute[74131]:   <name>instance-00000006</name>
Oct 20 16:20:04 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:20:04 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:20:04 user nova-compute[74131]:   <metadata>
Oct 20 16:20:04 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:20:04 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:20:04 user nova-compute[74131]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1984275987</nova:name>
Oct 20 16:20:04 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:20:04</nova:creationTime>
Oct 20 16:20:04 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:20:04 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:20:04 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:20:04 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:20:04 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:20:04 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:20:04 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:20:04 user nova-compute[74131]:       <nova:owner>
Oct 20 16:20:04 user nova-compute[74131]:         <nova:user uuid="b5b50ea489fb4e1b85431adc0fadff01">tempest-VolumesAssistedSnapshotsTest-59096444-project-member</nova:user>
Oct 20 16:20:04 user nova-compute[74131]:         <nova:project uuid="4c6ab47cdc124a01b239914da533b04a">tempest-VolumesAssistedSnapshotsTest-59096444</nova:project>
Oct 20 16:20:04 user nova-compute[74131]:       </nova:owner>
Oct 20 16:20:04 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:20:04 user nova-compute[74131]:       <nova:ports>
Oct 20 16:20:04 user nova-compute[74131]:         <nova:port uuid="29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3">
Oct 20 16:20:04 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:20:04 user nova-compute[74131]:         </nova:port>
Oct 20 16:20:04 user nova-compute[74131]:       </nova:ports>
Oct 20 16:20:04 user nova-compute[74131]:     </nova:instance>
Oct 20 16:20:04 user nova-compute[74131]:   </metadata>
Oct 20 16:20:04 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:20:04 user nova-compute[74131]:     <system>
Oct 20 16:20:04 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:20:04 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:20:04 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:20:04 user nova-compute[74131]:       <entry name="serial">fe867561-330e-4ccd-a012-46d4420bcbaf</entry>
Oct 20 16:20:04 user nova-compute[74131]:       <entry name="uuid">fe867561-330e-4ccd-a012-46d4420bcbaf</entry>
Oct 20 16:20:04 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:20:04 user nova-compute[74131]:     </system>
Oct 20 16:20:04 user nova-compute[74131]:   </sysinfo>
Oct 20 16:20:04 user nova-compute[74131]:   <os>
Oct 20 16:20:04 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:20:04 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:20:04 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:20:04 user nova-compute[74131]:   </os>
Oct 20 16:20:04 user nova-compute[74131]:   <features>
Oct 20 16:20:04 user nova-compute[74131]:     <acpi/>
Oct 20 16:20:04 user nova-compute[74131]:     <apic/>
Oct 20 16:20:04 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:20:04 user nova-compute[74131]:   </features>
Oct 20 16:20:04 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:20:04 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:20:04 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:20:04 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:20:04 user nova-compute[74131]:   </clock>
Oct 20 16:20:04 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:20:04 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:20:04 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:20:04 user nova-compute[74131]:   </cpu>
Oct 20 16:20:04 user nova-compute[74131]:   <devices>
Oct 20 16:20:04 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:20:04 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:20:04 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk"/>
Oct 20 16:20:04 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:20:04 user nova-compute[74131]:     </disk>
Oct 20 16:20:04 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:20:04 user nova-compute[74131]:       <mac address="fa:16:3e:87:d0:fc"/>
Oct 20 16:20:04 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:20:04 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:20:04 user nova-compute[74131]:       <target dev="tap29ea0f22-8e"/>
Oct 20 16:20:04 user nova-compute[74131]:     </interface>
Oct 20 16:20:04 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:20:04 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/console.log" append="off"/>
Oct 20 16:20:04 user nova-compute[74131]:     </serial>
Oct 20 16:20:04 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:20:04 user nova-compute[74131]:     <video>
Oct 20 16:20:04 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:20:04 user nova-compute[74131]:     </video>
Oct 20 16:20:04 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:20:04 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:20:04 user nova-compute[74131]:     </rng>
Oct 20 16:20:04 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:20:04 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:20:04 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:20:04 user nova-compute[74131]:     </memballoon>
Oct 20 16:20:04 user nova-compute[74131]:   </devices>
Oct 20 16:20:04 user nova-compute[74131]: </domain>
Oct 20 16:20:04 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1984275987',display_name='tempest-VolumesAssistedSnapshotsTest-server-1984275987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1984275987',id=6,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrLc7dXT9RmL73/GdWei1ZnbVpp2GjoEY+RO3cx1rPc5dD/9basloB4UUuv7CcFlRo3G7zLjhHhGndHDE8Qh2B24mzv6WY7MdKiyYxGwGesKcBAUNh3RNYYJj9MNkol/Q==',key_name='tempest-keypair-1653230815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6ab47cdc124a01b239914da533b04a',ramdisk_id='',reservation_id='r-mk30bsg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-59096444',owner_user_name='tempest-VolumesAssistedSnapshotsTest-59096444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5b50ea489fb4e1b85431adc0fadff01',uuid=fe867561-330e-4ccd-a012-46d4420bcbaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Converting VIF {"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d0:fc,bridge_name='br-int',has_traffic_filtering=True,id=29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3,network=Network(baab4a05-0596-4ada-8bba-a3deae96c806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ea0f22-8e') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG os_vif [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d0:fc,bridge_name='br-int',has_traffic_filtering=True,id=29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3,network=Network(baab4a05-0596-4ada-8bba-a3deae96c806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ea0f22-8e') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ee4a7a3-a5d4-531b-a26b-03a2b940d634', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ea0f22-8e, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29ea0f22-8e, col_values=(('qos', UUID('3c269a66-d207-4e8e-9a3f-a3965f30e122')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29ea0f22-8e, col_values=(('external_ids', {'iface-id': '29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:d0:fc', 'vm-uuid': 'fe867561-330e-4ccd-a012-46d4420bcbaf'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:04 user nova-compute[74131]: INFO os_vif [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d0:fc,bridge_name='br-int',has_traffic_filtering=True,id=29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3,network=Network(baab4a05-0596-4ada-8bba-a3deae96c806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ea0f22-8e')
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] No VIF found with MAC fa:16:3e:87:d0:fc, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Updated VIF entry in instance network info cache for port 29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Updating instance_info_cache with network_info: [{"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b8ff148-ac44-4167-80d2-53bca9f650f6 req-deefad93-5785-4c2e-a42e-f28927623e06 service nova] Releasing lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:20:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-1c17e775-1d21-4dee-86d9-2c12e1763f09 req-7b64e6cd-7766-48ac-85b9-3b3662be6b2e service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c17e775-1d21-4dee-86d9-2c12e1763f09 req-7b64e6cd-7766-48ac-85b9-3b3662be6b2e service nova] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c17e775-1d21-4dee-86d9-2c12e1763f09 req-7b64e6cd-7766-48ac-85b9-3b3662be6b2e service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c17e775-1d21-4dee-86d9-2c12e1763f09 req-7b64e6cd-7766-48ac-85b9-3b3662be6b2e service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-1c17e775-1d21-4dee-86d9-2c12e1763f09 req-7b64e6cd-7766-48ac-85b9-3b3662be6b2e service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] No waiting events found dispatching network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:06 user nova-compute[74131]: WARNING nova.compute.manager [req-1c17e775-1d21-4dee-86d9-2c12e1763f09 req-7b64e6cd-7766-48ac-85b9-3b3662be6b2e service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received unexpected event network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 for instance with vm_state building and task_state spawning.
Oct 20 16:20:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:20:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:20:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Skipping network cache update for instance because it is Building. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-d777003d-f928-44fb-bb11-ad7e4012d50d req-122d2efd-711f-43bb-ac97-e11b8a9b8fe9 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d777003d-f928-44fb-bb11-ad7e4012d50d req-122d2efd-711f-43bb-ac97-e11b8a9b8fe9 service nova] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d777003d-f928-44fb-bb11-ad7e4012d50d req-122d2efd-711f-43bb-ac97-e11b8a9b8fe9 service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d777003d-f928-44fb-bb11-ad7e4012d50d req-122d2efd-711f-43bb-ac97-e11b8a9b8fe9 service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-d777003d-f928-44fb-bb11-ad7e4012d50d req-122d2efd-711f-43bb-ac97-e11b8a9b8fe9 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] No waiting events found dispatching network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:08 user nova-compute[74131]: WARNING nova.compute.manager [req-d777003d-f928-44fb-bb11-ad7e4012d50d req-122d2efd-711f-43bb-ac97-e11b8a9b8fe9 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received unexpected event network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 for instance with vm_state building and task_state spawning.
Oct 20 16:20:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Updating instance_info_cache with network_info: [{"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-1889a30c-75e7-452a-b804-3dc6a2d5b2d9" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:20:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Instance spawned successfully.
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:09 user nova-compute[74131]: INFO nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Took 7.13 seconds to spawn the instance on the hypervisor.
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:20:09 user nova-compute[74131]: INFO nova.compute.manager [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Took 8.11 seconds to build instance.
Oct 20 16:20:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9165bc56-ed84-49a2-82e7-752f68b97008 tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.449s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.005s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:09 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8047MB free_disk=25.68079376220703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3e22a492-a812-415d-92c1-3cc51b842cc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance eea7c78b-928f-4e65-956a-cb57026ef891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6f5e776-329d-4e3c-a18c-ca4a01789def actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance fe867561-330e-4ccd-a012-46d4420bcbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:20:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.898s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:20:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "5b627751-886a-4ae3-8027-d48db36f8269" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "5b627751-886a-4ae3-8027-d48db36f8269" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:19 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:20:19 user nova-compute[74131]: INFO nova.compute.claims [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Claim successful on node user
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:20:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.policy [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38e781094ef6424f8af6b8453fb5a9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154d78ec7c55437f899034d0b89d57b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:20:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Creating image(s)
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "/opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "/opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk 1073741824" returned: 0 in 0.050s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Successfully created port: bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Cannot resize image /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Ensure instance console log exists: /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Successfully updated port: bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "refresh_cache-5b627751-886a-4ae3-8027-d48db36f8269" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquired lock "refresh_cache-5b627751-886a-4ae3-8027-d48db36f8269" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received event network-changed-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Refreshing instance network info cache due to event network-changed-bc6a4e3f-0a82-46f1-9fa5-009b9948b510. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] Acquiring lock "refresh_cache-5b627751-886a-4ae3-8027-d48db36f8269" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Updating instance_info_cache with network_info: [{"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Releasing lock "refresh_cache-5b627751-886a-4ae3-8027-d48db36f8269" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Instance network_info: |[{"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] Acquired lock "refresh_cache-5b627751-886a-4ae3-8027-d48db36f8269" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Refreshing network info cache for port bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Start _get_guest_xml network_info=[{"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:20:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1745900382',display_name='tempest-VolumesActionsTest-instance-1745900382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1745900382',id=7,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154d78ec7c55437f899034d0b89d57b7',ramdisk_id='',reservation_id='r-9tizpd0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1916779670',owner_user_name='tempest-VolumesActionsTest-1916779670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:20:20Z,user_data=None,user_id='38e781094ef6424f8af6b8453fb5a9af',uuid=5b627751-886a-4ae3-8027-d48db36f8269,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Converting VIF {"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:19:74,bridge_name='br-int',has_traffic_filtering=True,id=bc6a4e3f-0a82-46f1-9fa5-009b9948b510,network=Network(764822b7-82ea-43d8-8877-fca289d4b147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc6a4e3f-0a') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b627751-886a-4ae3-8027-d48db36f8269 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:20:22 user nova-compute[74131]:   <uuid>5b627751-886a-4ae3-8027-d48db36f8269</uuid>
Oct 20 16:20:22 user nova-compute[74131]:   <name>instance-00000007</name>
Oct 20 16:20:22 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:20:22 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:20:22 user nova-compute[74131]:   <metadata>
Oct 20 16:20:22 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:20:22 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:20:22 user nova-compute[74131]:       <nova:name>tempest-VolumesActionsTest-instance-1745900382</nova:name>
Oct 20 16:20:22 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:20:22</nova:creationTime>
Oct 20 16:20:22 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:20:22 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:20:22 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:20:22 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:20:22 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:20:22 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:20:22 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:20:22 user nova-compute[74131]:       <nova:owner>
Oct 20 16:20:22 user nova-compute[74131]:         <nova:user uuid="38e781094ef6424f8af6b8453fb5a9af">tempest-VolumesActionsTest-1916779670-project-member</nova:user>
Oct 20 16:20:22 user nova-compute[74131]:         <nova:project uuid="154d78ec7c55437f899034d0b89d57b7">tempest-VolumesActionsTest-1916779670</nova:project>
Oct 20 16:20:22 user nova-compute[74131]:       </nova:owner>
Oct 20 16:20:22 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:20:22 user nova-compute[74131]:       <nova:ports>
Oct 20 16:20:22 user nova-compute[74131]:         <nova:port uuid="bc6a4e3f-0a82-46f1-9fa5-009b9948b510">
Oct 20 16:20:22 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:20:22 user nova-compute[74131]:         </nova:port>
Oct 20 16:20:22 user nova-compute[74131]:       </nova:ports>
Oct 20 16:20:22 user nova-compute[74131]:     </nova:instance>
Oct 20 16:20:22 user nova-compute[74131]:   </metadata>
Oct 20 16:20:22 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:20:22 user nova-compute[74131]:     <system>
Oct 20 16:20:22 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:20:22 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:20:22 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:20:22 user nova-compute[74131]:       <entry name="serial">5b627751-886a-4ae3-8027-d48db36f8269</entry>
Oct 20 16:20:22 user nova-compute[74131]:       <entry name="uuid">5b627751-886a-4ae3-8027-d48db36f8269</entry>
Oct 20 16:20:22 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:20:22 user nova-compute[74131]:     </system>
Oct 20 16:20:22 user nova-compute[74131]:   </sysinfo>
Oct 20 16:20:22 user nova-compute[74131]:   <os>
Oct 20 16:20:22 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:20:22 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:20:22 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:20:22 user nova-compute[74131]:   </os>
Oct 20 16:20:22 user nova-compute[74131]:   <features>
Oct 20 16:20:22 user nova-compute[74131]:     <acpi/>
Oct 20 16:20:22 user nova-compute[74131]:     <apic/>
Oct 20 16:20:22 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:20:22 user nova-compute[74131]:   </features>
Oct 20 16:20:22 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:20:22 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:20:22 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:20:22 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:20:22 user nova-compute[74131]:   </clock>
Oct 20 16:20:22 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:20:22 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:20:22 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:20:22 user nova-compute[74131]:   </cpu>
Oct 20 16:20:22 user nova-compute[74131]:   <devices>
Oct 20 16:20:22 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:20:22 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:20:22 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk"/>
Oct 20 16:20:22 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:20:22 user nova-compute[74131]:     </disk>
Oct 20 16:20:22 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:20:22 user nova-compute[74131]:       <mac address="fa:16:3e:00:19:74"/>
Oct 20 16:20:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:20:22 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:20:22 user nova-compute[74131]:       <target dev="tapbc6a4e3f-0a"/>
Oct 20 16:20:22 user nova-compute[74131]:     </interface>
Oct 20 16:20:22 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:20:22 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/console.log" append="off"/>
Oct 20 16:20:22 user nova-compute[74131]:     </serial>
Oct 20 16:20:22 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:20:22 user nova-compute[74131]:     <video>
Oct 20 16:20:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:20:22 user nova-compute[74131]:     </video>
Oct 20 16:20:22 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:20:22 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:20:22 user nova-compute[74131]:     </rng>
Oct 20 16:20:22 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:20:22 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:20:22 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:20:22 user nova-compute[74131]:     </memballoon>
Oct 20 16:20:22 user nova-compute[74131]:   </devices>
Oct 20 16:20:22 user nova-compute[74131]: </domain>
Oct 20 16:20:22 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1745900382',display_name='tempest-VolumesActionsTest-instance-1745900382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1745900382',id=7,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154d78ec7c55437f899034d0b89d57b7',ramdisk_id='',reservation_id='r-9tizpd0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1916779670',owner_user_name='tempest-VolumesActionsTest-1916779670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:20:20Z,user_data=None,user_id='38e781094ef6424f8af6b8453fb5a9af',uuid=5b627751-886a-4ae3-8027-d48db36f8269,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Converting VIF {"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:19:74,bridge_name='br-int',has_traffic_filtering=True,id=bc6a4e3f-0a82-46f1-9fa5-009b9948b510,network=Network(764822b7-82ea-43d8-8877-fca289d4b147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc6a4e3f-0a') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG os_vif [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:19:74,bridge_name='br-int',has_traffic_filtering=True,id=bc6a4e3f-0a82-46f1-9fa5-009b9948b510,network=Network(764822b7-82ea-43d8-8877-fca289d4b147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc6a4e3f-0a') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a537fe3d-312e-51a8-868b-b2563772b751', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc6a4e3f-0a, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc6a4e3f-0a, col_values=(('qos', UUID('fcc97a92-d3d2-483f-a3ee-521baa481768')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc6a4e3f-0a, col_values=(('external_ids', {'iface-id': 'bc6a4e3f-0a82-46f1-9fa5-009b9948b510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:19:74', 'vm-uuid': '5b627751-886a-4ae3-8027-d48db36f8269'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:20:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:22 user nova-compute[74131]: INFO os_vif [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:19:74,bridge_name='br-int',has_traffic_filtering=True,id=bc6a4e3f-0a82-46f1-9fa5-009b9948b510,network=Network(764822b7-82ea-43d8-8877-fca289d4b147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc6a4e3f-0a')
Oct 20 16:20:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:20:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] No VIF found with MAC fa:16:3e:00:19:74, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:20:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Updated VIF entry in instance network info cache for port bc6a4e3f-0a82-46f1-9fa5-009b9948b510. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:20:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Updating instance_info_cache with network_info: [{"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:20:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-308a3c30-50b9-4145-8344-0d4db759aa16 req-6681d244-6aeb-4971-80f9-4e664400797d service nova] Releasing lock "refresh_cache-5b627751-886a-4ae3-8027-d48db36f8269" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-0243e09e-13b5-4a46-b184-230be9142a05 req-c753648b-bd34-487d-b940-5fe386da6815 service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received event network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0243e09e-13b5-4a46-b184-230be9142a05 req-c753648b-bd34-487d-b940-5fe386da6815 service nova] Acquiring lock "5b627751-886a-4ae3-8027-d48db36f8269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0243e09e-13b5-4a46-b184-230be9142a05 req-c753648b-bd34-487d-b940-5fe386da6815 service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0243e09e-13b5-4a46-b184-230be9142a05 req-c753648b-bd34-487d-b940-5fe386da6815 service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-0243e09e-13b5-4a46-b184-230be9142a05 req-c753648b-bd34-487d-b940-5fe386da6815 service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] No waiting events found dispatching network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:24 user nova-compute[74131]: WARNING nova.compute.manager [req-0243e09e-13b5-4a46-b184-230be9142a05 req-c753648b-bd34-487d-b940-5fe386da6815 service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received unexpected event network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 for instance with vm_state building and task_state spawning.
Oct 20 16:20:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-828d2c13-6531-4a3f-a2ff-0cda633e4262 req-d467f560-b360-4777-b5b5-723bfee94c00 service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received event network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-828d2c13-6531-4a3f-a2ff-0cda633e4262 req-d467f560-b360-4777-b5b5-723bfee94c00 service nova] Acquiring lock "5b627751-886a-4ae3-8027-d48db36f8269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-828d2c13-6531-4a3f-a2ff-0cda633e4262 req-d467f560-b360-4777-b5b5-723bfee94c00 service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-828d2c13-6531-4a3f-a2ff-0cda633e4262 req-d467f560-b360-4777-b5b5-723bfee94c00 service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-828d2c13-6531-4a3f-a2ff-0cda633e4262 req-d467f560-b360-4777-b5b5-723bfee94c00 service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] No waiting events found dispatching network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:26 user nova-compute[74131]: WARNING nova.compute.manager [req-828d2c13-6531-4a3f-a2ff-0cda633e4262 req-d467f560-b360-4777-b5b5-723bfee94c00 service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received unexpected event network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 for instance with vm_state building and task_state spawning.
Oct 20 16:20:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:20:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:20:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Instance spawned successfully.
Oct 20 16:20:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:20:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:27 user nova-compute[74131]: INFO nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Took 6.59 seconds to spawn the instance on the hypervisor.
Oct 20 16:20:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:20:27 user nova-compute[74131]: INFO nova.compute.manager [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Took 7.51 seconds to build instance.
Oct 20 16:20:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fea45e75-d53c-4b94-9918-fb6ad4aede61 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "5b627751-886a-4ae3-8027-d48db36f8269" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.640s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:20:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:33 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:20:33 user nova-compute[74131]: INFO nova.compute.claims [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Claim successful on node user
Oct 20 16:20:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:34 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:20:34 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:20:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:20:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:20:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:20:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:20:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:20:34 user nova-compute[74131]: DEBUG nova.policy [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7afdf3b099374db9a370162d951c9f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271c255eceee494a88cb94ce0782cdac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:20:34 user nova-compute[74131]: INFO nova.virt.block_device [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Booting with volume 3c25cebe-bc8c-40af-81e6-4d28c5e7f158 at /dev/vda
Oct 20 16:20:34 user nova-compute[74131]: DEBUG os_brick.utils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:20:34 user nova-compute[74131]: INFO oslo.privsep.daemon [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3b_m5wam/privsep.sock']
Oct 20 16:20:34 user sudo[84840]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3b_m5wam/privsep.sock
Oct 20 16:20:34 user sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 16:20:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Successfully created port: c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Successfully updated port: c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquired lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-changed-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Refreshing instance network info cache due to event network-changed-c9e6dc02-3b44-4572-ba36-213377f08203. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] Acquiring lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:20:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:20:36 user sudo[84840]: pam_unix(sudo:session): session closed for user root
Oct 20 16:20:36 user nova-compute[74131]: INFO oslo.privsep.daemon [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Spawned new privsep daemon via rootwrap
Oct 20 16:20:36 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 16:20:36 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 16:20:36 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 16:20:36 user nova-compute[74131]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84843
Oct 20 16:20:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updating instance_info_cache with network_info: [{"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Releasing lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance network_info: |[{"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] Acquired lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Refreshing network info cache for port c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe790f4f-9008-400f-9443-c859d6a6188f]: (2,) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e6e51b-46f7-42ac-b86c-14f9f210da57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:36 user nova-compute[74131]: WARNING os_brick.initiator.connectors.nvmeof [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5758a3a-2c30-4456-bddc-f1bc853ccb07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ec8176-fc71-45de-bdea-aea3cc73047a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f965e6bd-2f1f-4793-8883-ea3975341e4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:20:36 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[546dcaf0-7f64-435e-8431-8068e52be8d1]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG os_brick.utils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] <== get_connector_properties: return (1955ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updating existing volume attachment record: 992c3f95-1186-430e-816c-9cbd4886df7b {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updated VIF entry in instance network info cache for port c9e6dc02-3b44-4572-ba36-213377f08203. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updating instance_info_cache with network_info: [{"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:20:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dd20d6bb-2c86-4714-b760-4a2fdcfab2f6 req-78bea4e5-14ae-445f-9bf5-e23c7e3e0016 service nova] Releasing lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:20:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:20:54 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Creating image(s)
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Ensure instance console log exists: /opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Start _get_guest_xml network_info=[{"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '992c3f95-1186-430e-816c-9cbd4886df7b', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2f0a264-c008-4a8d-a043-e3d391371e03', 'attached_at': '', 'detached_at': '', 'volume_id': '3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'serial': '3c25cebe-bc8c-40af-81e6-4d28c5e7f158'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:20:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connector [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Factory for ISCSI on None {{(pid=74131) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:20:54 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:20:54 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:20:54 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed635a9-5ca6-4491-a9b1-a50dc05329a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:20:54 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6311cec-2411-49d7-9ea9-c2116180f91c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158] added
Oct 20 16:20:54 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59b3689-dfa3-43c0-acac-bdc42d3a41e5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[592716e4-991d-4d4f-976b-25e6f2b5d782]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnoeEyXS {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnoeEyXS" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c7d54-5251-49dd-9e4a-c3e6eaf18dc4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RnoeEyXS'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94b28b-fefa-43e1-b45f-577da105a69a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[38691a4f-2da7-42ab-8e42-2514580c2243]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:20:55 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:20:55 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:20:55 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 16:20:55 user nova-compute[74131]: 
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5663d39c-20f8-470b-8475-1d905a2d61f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]
Oct 20 16:20:55 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.
Oct 20 16:20:55 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c674094b-80a0-43ba-a407-6089948497f2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e51338-649f-4d14-985d-61e8db443dcc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:20:55 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:20:55 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe61b89-d48d-49ab-ae68-a330a29706b1]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:20:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26463356233643339', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463356233643339', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2143544802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2143544802',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc4XMoxY4Dg+61kJ87kel36Y/5nH7VTQZrzEJv51BivlA49XZaf3Bj9QPbaGeYwls5bkzRLFgBw92nCYLyRqtpE8UqiU8SJyy2XjeM7IMfT3Enbm1zJVOMIEoid2i/ueQ==',key_name='tempest-keypair-694396898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='271c255eceee494a88cb94ce0782cdac',ramdisk_id='',reservation_id='r-kb184yfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-153044646',owner_user_name='tempest-ServerActionsV293TestJSON-153044646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7afdf3b099374db9a370162d951c9f9c',uuid=d2f0a264-c008-4a8d-a043-e3d391371e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converting VIF {"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lazy-loading 'pci_devices' on Instance uuid d2f0a264-c008-4a8d-a043-e3d391371e03 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:20:56 user nova-compute[74131]:   <uuid>d2f0a264-c008-4a8d-a043-e3d391371e03</uuid>
Oct 20 16:20:56 user nova-compute[74131]:   <name>instance-00000008</name>
Oct 20 16:20:56 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:20:56 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:20:56 user nova-compute[74131]:   <metadata>
Oct 20 16:20:56 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:20:56 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:20:56 user nova-compute[74131]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2143544802</nova:name>
Oct 20 16:20:56 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:20:54</nova:creationTime>
Oct 20 16:20:56 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:20:56 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:20:56 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:20:56 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:20:56 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:20:56 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:20:56 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:20:56 user nova-compute[74131]:       <nova:owner>
Oct 20 16:20:56 user nova-compute[74131]:         <nova:user uuid="7afdf3b099374db9a370162d951c9f9c">tempest-ServerActionsV293TestJSON-153044646-project-member</nova:user>
Oct 20 16:20:56 user nova-compute[74131]:         <nova:project uuid="271c255eceee494a88cb94ce0782cdac">tempest-ServerActionsV293TestJSON-153044646</nova:project>
Oct 20 16:20:56 user nova-compute[74131]:       </nova:owner>
Oct 20 16:20:56 user nova-compute[74131]:       <nova:ports>
Oct 20 16:20:56 user nova-compute[74131]:         <nova:port uuid="c9e6dc02-3b44-4572-ba36-213377f08203">
Oct 20 16:20:56 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:20:56 user nova-compute[74131]:         </nova:port>
Oct 20 16:20:56 user nova-compute[74131]:       </nova:ports>
Oct 20 16:20:56 user nova-compute[74131]:     </nova:instance>
Oct 20 16:20:56 user nova-compute[74131]:   </metadata>
Oct 20 16:20:56 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:20:56 user nova-compute[74131]:     <system>
Oct 20 16:20:56 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:20:56 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:20:56 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:20:56 user nova-compute[74131]:       <entry name="serial">d2f0a264-c008-4a8d-a043-e3d391371e03</entry>
Oct 20 16:20:56 user nova-compute[74131]:       <entry name="uuid">d2f0a264-c008-4a8d-a043-e3d391371e03</entry>
Oct 20 16:20:56 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:20:56 user nova-compute[74131]:     </system>
Oct 20 16:20:56 user nova-compute[74131]:   </sysinfo>
Oct 20 16:20:56 user nova-compute[74131]:   <os>
Oct 20 16:20:56 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:20:56 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:20:56 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:20:56 user nova-compute[74131]:   </os>
Oct 20 16:20:56 user nova-compute[74131]:   <features>
Oct 20 16:20:56 user nova-compute[74131]:     <acpi/>
Oct 20 16:20:56 user nova-compute[74131]:     <apic/>
Oct 20 16:20:56 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:20:56 user nova-compute[74131]:   </features>
Oct 20 16:20:56 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:20:56 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:20:56 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:20:56 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:20:56 user nova-compute[74131]:   </clock>
Oct 20 16:20:56 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:20:56 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:20:56 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:20:56 user nova-compute[74131]:   </cpu>
Oct 20 16:20:56 user nova-compute[74131]:   <devices>
Oct 20 16:20:56 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:20:56 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:20:56 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 16:20:56 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:20:56 user nova-compute[74131]:       <serial>3c25cebe-bc8c-40af-81e6-4d28c5e7f158</serial>
Oct 20 16:20:56 user nova-compute[74131]:     </disk>
Oct 20 16:20:56 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:20:56 user nova-compute[74131]:       <mac address="fa:16:3e:89:15:de"/>
Oct 20 16:20:56 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:20:56 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:20:56 user nova-compute[74131]:       <target dev="tapc9e6dc02-3b"/>
Oct 20 16:20:56 user nova-compute[74131]:     </interface>
Oct 20 16:20:56 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:20:56 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03/console.log" append="off"/>
Oct 20 16:20:56 user nova-compute[74131]:     </serial>
Oct 20 16:20:56 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:20:56 user nova-compute[74131]:     <video>
Oct 20 16:20:56 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:20:56 user nova-compute[74131]:     </video>
Oct 20 16:20:56 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:20:56 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:20:56 user nova-compute[74131]:     </rng>
Oct 20 16:20:56 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:20:56 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:20:56 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:20:56 user nova-compute[74131]:     </memballoon>
Oct 20 16:20:56 user nova-compute[74131]:   </devices>
Oct 20 16:20:56 user nova-compute[74131]: </domain>
Oct 20 16:20:56 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2143544802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2143544802',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc4XMoxY4Dg+61kJ87kel36Y/5nH7VTQZrzEJv51BivlA49XZaf3Bj9QPbaGeYwls5bkzRLFgBw92nCYLyRqtpE8UqiU8SJyy2XjeM7IMfT3Enbm1zJVOMIEoid2i/ueQ==',key_name='tempest-keypair-694396898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='271c255eceee494a88cb94ce0782cdac',ramdisk_id='',reservation_id='r-kb184yfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-153044646',owner_user_name='tempest-ServerActionsV293TestJSON-153044646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7afdf3b099374db9a370162d951c9f9c',uuid=d2f0a264-c008-4a8d-a043-e3d391371e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converting VIF {"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG os_vif [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fef64ed-8dd0-5a9e-b036-6f6a39786cd4', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9e6dc02-3b, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9e6dc02-3b, col_values=(('qos', UUID('9a754da2-46e8-48fd-b2c1-a8c039d9fad9')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9e6dc02-3b, col_values=(('external_ids', {'iface-id': 'c9e6dc02-3b44-4572-ba36-213377f08203', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:15:de', 'vm-uuid': 'd2f0a264-c008-4a8d-a043-e3d391371e03'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:56 user nova-compute[74131]: INFO os_vif [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b')
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:20:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] No VIF found with MAC fa:16:3e:89:15:de, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-206f2b00-2856-4b51-8e10-877ec0fc75c2 req-3200fa83-8198-40c0-8458-a6306b45dfa5 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-206f2b00-2856-4b51-8e10-877ec0fc75c2 req-3200fa83-8198-40c0-8458-a6306b45dfa5 service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-206f2b00-2856-4b51-8e10-877ec0fc75c2 req-3200fa83-8198-40c0-8458-a6306b45dfa5 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-206f2b00-2856-4b51-8e10-877ec0fc75c2 req-3200fa83-8198-40c0-8458-a6306b45dfa5 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-206f2b00-2856-4b51-8e10-877ec0fc75c2 req-3200fa83-8198-40c0-8458-a6306b45dfa5 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:57 user nova-compute[74131]: WARNING nova.compute.manager [req-206f2b00-2856-4b51-8e10-877ec0fc75c2 req-3200fa83-8198-40c0-8458-a6306b45dfa5 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received unexpected event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with vm_state building and task_state spawning.
Oct 20 16:20:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:20:59 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance spawned successfully.
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-098d52c6-f54b-484c-8cbb-04512f74e798 req-3773cac4-58f6-4e04-8f8e-8a2189888656 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-098d52c6-f54b-484c-8cbb-04512f74e798 req-3773cac4-58f6-4e04-8f8e-8a2189888656 service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-098d52c6-f54b-484c-8cbb-04512f74e798 req-3773cac4-58f6-4e04-8f8e-8a2189888656 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-098d52c6-f54b-484c-8cbb-04512f74e798 req-3773cac4-58f6-4e04-8f8e-8a2189888656 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:20:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-098d52c6-f54b-484c-8cbb-04512f74e798 req-3773cac4-58f6-4e04-8f8e-8a2189888656 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:20:59 user nova-compute[74131]: WARNING nova.compute.manager [req-098d52c6-f54b-484c-8cbb-04512f74e798 req-3773cac4-58f6-4e04-8f8e-8a2189888656 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received unexpected event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with vm_state building and task_state spawning.
Oct 20 16:21:00 user nova-compute[74131]: INFO nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 20 16:21:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:21:00 user nova-compute[74131]: INFO nova.compute.manager [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Took 26.37 seconds to build instance.
Oct 20 16:21:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e908b2b8-41c1-43e3-9326-c4e1b1bcdfde tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.509s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG nova.objects.instance [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lazy-loading 'flavor' on Instance uuid 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:10 user nova-compute[74131]: INFO nova.compute.manager [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Attaching volume e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 to /dev/vdb
Oct 20 16:21:10 user nova-compute[74131]: DEBUG os_brick.utils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f48f917-fc3a-4982-88ae-7a96a8904cff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1d3585-0035-472a-916f-36f2ab68d465]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating instance_info_cache with network_info: [{"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c6a926-6e13-4ff7-a20a-ef629b7341ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c71df1-c8ca-4da1-bd74-ff024b8d11fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:10 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1527a75-2a72-4d27-bef9-f16d994d5816]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG os_brick.utils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Updating existing volume attachment record: e1ad1dc6-e9ec-4dc5-9990-a510c467002f {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:21:11 user nova-compute[74131]: INFO nova.compute.claims [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Claim successful on node user
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "3308d7fc-97c0-4491-89da-b2c764637509" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.999s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:21:12 user nova-compute[74131]: INFO nova.compute.claims [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Claim successful on node user
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: INFO nova.virt.block_device [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Booting with volume bd32cf37-0b04-47c4-8220-5be5ba52521b at /dev/vda
Oct 20 16:21:12 user nova-compute[74131]: DEBUG nova.policy [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a9c73d128c04e65a98bf1beb30b5a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7731c7dd721a4ffca10b9a305aedc1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG os_brick.utils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[328dfb91-1155-4be1-b019-3bbd850adbd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[60de7eae-53f9-466a-b042-614176c84cb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[965fed23-c732-4cc4-91b4-5de0754d1ee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4304c70-ce65-4727-941d-fc542938e4fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:13 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ba5f86-7bb2-48e4-89c1-9cce021e961b]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG os_brick.utils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating existing volume attachment record: 7edc88e4-98f3-4b25-8b7c-ea903b65f429 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.compute.manager [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-changed-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.compute.manager [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Refreshing instance network info cache due to event network-changed-f9c05f0f-9d46-4970-a524-d66c38905e0e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] Acquiring lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] Acquired lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.network.neutron [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Refreshing network info cache for port f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.954s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:21:13 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:13 user nova-compute[74131]: DEBUG nova.policy [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9802f39e1c04548b788f94302d2406f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ffe9b3287344cb979587e0f18bc99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:21:13 user nova-compute[74131]: INFO nova.virt.block_device [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Booting with volume 217944a7-0357-4339-84be-09d598f35aad at /dev/vda
Oct 20 16:21:14 user nova-compute[74131]: DEBUG nova.network.neutron [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updated VIF entry in instance network info cache for port f9c05f0f-9d46-4970-a524-d66c38905e0e. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:14 user nova-compute[74131]: DEBUG nova.network.neutron [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating instance_info_cache with network_info: [{"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9292cd38-6f2a-43a2-b5d6-1b863b1e53f4 req-94756cb9-0e06-4a0f-ab31-1f121e3cc41e service nova] Releasing lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:14 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully created port: 99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully created port: 1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:15 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:21:15 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=25.574100494384766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG os_brick.utils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c731da-48f4-4bf5-9285-6cc3faa89116]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e39f67-4821-4a42-a49e-eaaf25626b14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c54577-457f-4766-9295-240b327b0a3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[285c1627-37b0-4f3e-b1d8-a5f66ddfbe7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3e22a492-a812-415d-92c1-3cc51b842cc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance eea7c78b-928f-4e65-956a-cb57026ef891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6f5e776-329d-4e3c-a18c-ca4a01789def actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance fe867561-330e-4ccd-a012-46d4420bcbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5b627751-886a-4ae3-8027-d48db36f8269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d2f0a264-c008-4a8d-a043-e3d391371e03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3308d7fc-97c0-4491-89da-b2c764637509 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:15 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:15 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bb26d8-f12f-4f85-9a29-5036a06c8e1f]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG os_brick.utils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating existing volume attachment record: 381e2ff0-9249-4eea-8f4b-50a4eb7d5604 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully created port: a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:21:15 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:21:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:21:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully created port: f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully created port: a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully created port: 5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:21:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully created port: a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully created port: d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:18 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully created port: c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:18 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully created port: ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully updated port: 1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully updated port: 99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-99757533-e66b-4bc8-97d0-7d48f34782bf. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port 99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-1bf41897-28d2-4330-9306-804c943a8411. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port 1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:21:19 user nova-compute[74131]: INFO nova.compute.claims [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Claim successful on node user
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7beea4e3-b635-4623-9732-762349942c5b req-c67c48b2-956a-4c96-af76-d67382196411 service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-42880db8-01ee-4c7c-a3e2-4f187e4818bf req-58cc3975-4e5f-499a-b046-8042e881de3f service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully updated port: 5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully updated port: 7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:21:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.policy [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9672540d35b644bda7c5f006cecc6870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b057c4fc24fb45e0a5bbf7ec5993c5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:21:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Creating image(s)
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "/opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "/opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "/opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully updated port: f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.192s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully updated port: a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk 1073741824" returned: 0 in 0.052s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Successfully created port: c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:21:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Cannot resize image /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Ensure instance console log exists: /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-5c568f79-cd10-49f5-83a9-b3c375a11c51. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port 5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-7c4de563-daf8-46aa-9b5b-23c9e24bcee2. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port 7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully updated port: f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Successfully updated port: c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-a5c275f1-5b09-4cf8-8590-8971595a828c. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquired lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-changed-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Refreshing instance network info cache due to event network-changed-c08fc7c0-8c6d-4d94-8e25-7dabdd052274. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] Acquiring lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully updated port: a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-f51a05ea-ef40-44f9-a969-6e9e420590bb. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5978fcfb-5b8b-4bfe-a559-6bc67883438a req-4b76f747-d952-4860-a16f-4517ad78e013 service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updating instance_info_cache with network_info: [{"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Releasing lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Instance network_info: |[{"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] Acquired lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Refreshing network info cache for port c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Start _get_guest_xml network_info=[{"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:21:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:21:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-920156016',display_name='tempest-TestServerVolumeAttachmentScenario-server-920156016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-920156016',id=11,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIChedWnd+1CIYNVcKzFq9n8m0mLo6ZtocrNTjqLprRKowUP9KGgFjdUHb2/hOcScwrpX0MmKLdme1bcnZe5awzTzokQTHiLtoMDmYu6Lmduc32+NSq8WLhTggH2niwBw==',key_name='tempest-keypair-1712730949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b057c4fc24fb45e0a5bbf7ec5993c5a7',ramdisk_id='',reservation_id='r-704xenid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-634653240',owner_user_name='tempest-TestServerVolumeAttachmentScenario-634653240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9672540d35b644bda7c5f006cecc6870',uuid=97808f8f-f8ae-40b6-ae3a-b7a209a2a64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Converting VIF {"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:88,bridge_name='br-int',has_traffic_filtering=True,id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274,network=Network(04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc08fc7c0-8c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'pci_devices' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:21:22 user nova-compute[74131]:   <uuid>97808f8f-f8ae-40b6-ae3a-b7a209a2a64d</uuid>
Oct 20 16:21:22 user nova-compute[74131]:   <name>instance-0000000b</name>
Oct 20 16:21:22 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:21:22 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:21:22 user nova-compute[74131]:   <metadata>
Oct 20 16:21:22 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:21:22 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:21:22 user nova-compute[74131]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-920156016</nova:name>
Oct 20 16:21:22 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:21:22</nova:creationTime>
Oct 20 16:21:22 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:21:22 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:21:22 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:21:22 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:21:22 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:21:22 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:21:22 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:21:22 user nova-compute[74131]:       <nova:owner>
Oct 20 16:21:22 user nova-compute[74131]:         <nova:user uuid="9672540d35b644bda7c5f006cecc6870">tempest-TestServerVolumeAttachmentScenario-634653240-project-member</nova:user>
Oct 20 16:21:22 user nova-compute[74131]:         <nova:project uuid="b057c4fc24fb45e0a5bbf7ec5993c5a7">tempest-TestServerVolumeAttachmentScenario-634653240</nova:project>
Oct 20 16:21:22 user nova-compute[74131]:       </nova:owner>
Oct 20 16:21:22 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:21:22 user nova-compute[74131]:       <nova:ports>
Oct 20 16:21:22 user nova-compute[74131]:         <nova:port uuid="c08fc7c0-8c6d-4d94-8e25-7dabdd052274">
Oct 20 16:21:22 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:21:22 user nova-compute[74131]:         </nova:port>
Oct 20 16:21:22 user nova-compute[74131]:       </nova:ports>
Oct 20 16:21:22 user nova-compute[74131]:     </nova:instance>
Oct 20 16:21:22 user nova-compute[74131]:   </metadata>
Oct 20 16:21:22 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:21:22 user nova-compute[74131]:     <system>
Oct 20 16:21:22 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:21:22 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:21:22 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:21:22 user nova-compute[74131]:       <entry name="serial">97808f8f-f8ae-40b6-ae3a-b7a209a2a64d</entry>
Oct 20 16:21:22 user nova-compute[74131]:       <entry name="uuid">97808f8f-f8ae-40b6-ae3a-b7a209a2a64d</entry>
Oct 20 16:21:22 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:21:22 user nova-compute[74131]:     </system>
Oct 20 16:21:22 user nova-compute[74131]:   </sysinfo>
Oct 20 16:21:22 user nova-compute[74131]:   <os>
Oct 20 16:21:22 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:21:22 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:21:22 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:21:22 user nova-compute[74131]:   </os>
Oct 20 16:21:22 user nova-compute[74131]:   <features>
Oct 20 16:21:22 user nova-compute[74131]:     <acpi/>
Oct 20 16:21:22 user nova-compute[74131]:     <apic/>
Oct 20 16:21:22 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:21:22 user nova-compute[74131]:   </features>
Oct 20 16:21:22 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:21:22 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:21:22 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:21:22 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:21:22 user nova-compute[74131]:   </clock>
Oct 20 16:21:22 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:21:22 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:21:22 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:21:22 user nova-compute[74131]:   </cpu>
Oct 20 16:21:22 user nova-compute[74131]:   <devices>
Oct 20 16:21:22 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:21:22 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:21:22 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk"/>
Oct 20 16:21:22 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:21:22 user nova-compute[74131]:     </disk>
Oct 20 16:21:22 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:21:22 user nova-compute[74131]:       <mac address="fa:16:3e:6e:26:88"/>
Oct 20 16:21:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:21:22 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:21:22 user nova-compute[74131]:       <target dev="tapc08fc7c0-8c"/>
Oct 20 16:21:22 user nova-compute[74131]:     </interface>
Oct 20 16:21:22 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:21:22 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/console.log" append="off"/>
Oct 20 16:21:22 user nova-compute[74131]:     </serial>
Oct 20 16:21:22 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:21:22 user nova-compute[74131]:     <video>
Oct 20 16:21:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:21:22 user nova-compute[74131]:     </video>
Oct 20 16:21:22 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:21:22 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:21:22 user nova-compute[74131]:     </rng>
Oct 20 16:21:22 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:21:22 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:21:22 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:21:22 user nova-compute[74131]:     </memballoon>
Oct 20 16:21:22 user nova-compute[74131]:   </devices>
Oct 20 16:21:22 user nova-compute[74131]: </domain>
Oct 20 16:21:22 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-920156016',display_name='tempest-TestServerVolumeAttachmentScenario-server-920156016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-920156016',id=11,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIChedWnd+1CIYNVcKzFq9n8m0mLo6ZtocrNTjqLprRKowUP9KGgFjdUHb2/hOcScwrpX0MmKLdme1bcnZe5awzTzokQTHiLtoMDmYu6Lmduc32+NSq8WLhTggH2niwBw==',key_name='tempest-keypair-1712730949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b057c4fc24fb45e0a5bbf7ec5993c5a7',ramdisk_id='',reservation_id='r-704xenid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-634653240',owner_user_name='tempest-TestServerVolumeAttachmentScenario-634653240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9672540d35b644bda7c5f006cecc6870',uuid=97808f8f-f8ae-40b6-ae3a-b7a209a2a64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Converting VIF {"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:88,bridge_name='br-int',has_traffic_filtering=True,id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274,network=Network(04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc08fc7c0-8c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG os_vif [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:88,bridge_name='br-int',has_traffic_filtering=True,id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274,network=Network(04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc08fc7c0-8c') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully updated port: 5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1481843-6b05-5fc1-a795-7baed4158bfa', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc08fc7c0-8c, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc08fc7c0-8c, col_values=(('qos', UUID('98ba1103-5c8d-466b-a186-813c6ecfb3af')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc08fc7c0-8c, col_values=(('external_ids', {'iface-id': 'c08fc7c0-8c6d-4d94-8e25-7dabdd052274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:26:88', 'vm-uuid': '97808f8f-f8ae-40b6-ae3a-b7a209a2a64d'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:22 user nova-compute[74131]: INFO os_vif [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:88,bridge_name='br-int',has_traffic_filtering=True,id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274,network=Network(04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc08fc7c0-8c')
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e3d4f3e-1cb3-49e1-9f50-707ae847b342 req-c6d919f3-7c38-401f-94cc-5bc8e3f04e6c service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No VIF found with MAC fa:16:3e:6e:26:88, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:21:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updated VIF entry in instance network info cache for port c08fc7c0-8c6d-4d94-8e25-7dabdd052274. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updating instance_info_cache with network_info: [{"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-658c24c9-3695-44ff-a8f9-2ad93d711f76 req-4fa760c6-e7f9-4072-a851-188925a0830c service nova] Releasing lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully updated port: a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-f300e70d-b38f-4f63-be92-3ec0c30ee8dc. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-a156a317-1011-417d-b4da-199d79eca471. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully updated port: d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-a146d40a-536f-4bec-8a48-d162c51c818e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port 5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6541c25-bcbd-4500-9be8-80b1a03289c0 req-31002c61-cd1a-428d-b9a7-06f987f420d3 service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully updated port: a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Successfully updated port: ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-03631be6-367b-42ee-a3fc-09060e56c854 req-ab638274-2a87-4cf6-90df-27f39aa57e91 service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:21:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Successfully updated port: c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-d6c9b25b-7ddc-447e-9571-c1a727de3f8e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-a567a97b-c472-4481-97db-7d7a4ef92ec1. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:21:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Instance spawned successfully.
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:21:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:27 user nova-compute[74131]: INFO nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Took 6.85 seconds to spawn the instance on the hypervisor.
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance network_info: |[{"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:27 user nova-compute[74131]: INFO nova.compute.manager [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Took 7.91 seconds to build instance.
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-61b9f9f2-93b6-4b08-a884-6784d28e2d00 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.058s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updated VIF entry in instance network info cache for port d6c9b25b-7ddc-447e-9571-c1a727de3f8e. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-ed445149-84d5-4acc-9ce3-d0d0a264cfc3. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance network_info: |[{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updated VIF entry in instance network info cache for port ed445149-84d5-4acc-9ce3-d0d0a264cfc3. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] No waiting events found dispatching network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:21:28 user nova-compute[74131]: WARNING nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received unexpected event network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 for instance with vm_state building and task_state spawning.
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] No waiting events found dispatching network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:21:28 user nova-compute[74131]: WARNING nova.compute.manager [req-7dda8ac0-b8c4-4f5a-b641-07c438723ace req-c9dc51d0-f26f-42b5-9f1b-c3b964d723a4 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received unexpected event network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 for instance with vm_state building and task_state spawning.
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updated VIF entry in instance network info cache for port a567a97b-c472-4481-97db-7d7a4ef92ec1. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-c1f7bff5-067d-4e94-9703-b3a03102c6bb. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updated VIF entry in instance network info cache for port c1f7bff5-067d-4e94-9703-b3a03102c6bb. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0c98b59-6d7f-489d-8c9a-0e7d29bff86f req-e23342a6-4525-4cd0-97da-b1636b811150 service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-changed-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Refreshing instance network info cache due to event network-changed-846a2357-b301-40b9-8bca-d3b22e092a24. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] Acquiring lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] Acquired lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Refreshing network info cache for port 846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:34 user nova-compute[74131]: INFO nova.virt.block_device [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Booting with volume 196a2605-accd-4a03-9534-4de4793e2192 at /dev/vdb
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG os_brick.utils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2414ef-5ce2-496b-924e-08ec68776741]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0ac4d-ec26-4f77-913b-13181c6d9f81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d671f8d4-d6c2-4fb3-955e-ca53ec315a6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b0aaa-5bce-432a-858e-cd81ec0e8ac0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:34 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcd5409-29c5-434e-beca-105b3bc6998f]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updated VIF entry in instance network info cache for port 846a2357-b301-40b9-8bca-d3b22e092a24. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG os_brick.utils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== get_connector_properties: return (230ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:34 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating existing volume attachment record: 834921e8-3966-4ec2-a6b9-5a84c32a47de {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-218a6198-f93a-442a-bffd-dc6bc7b42a7a req-42ee74c2-b15a-403a-8c22-ba7df92bc016 service nova] Releasing lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "interface-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "interface-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'flavor' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:35 user nova-compute[74131]: INFO nova.compute.manager [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Attaching volume 387825ee-5645-4ed4-9f4a-0eec9182ec63 to /dev/vdb
Oct 20 16:21:35 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'pci_requests' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG nova.objects.base [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Object Instance<ee67f6fa-6b81-46b5-a3cc-ef756c0ad477> lazy-loaded attributes: flavor,pci_requests {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:21:35 user nova-compute[74131]: DEBUG nova.policy [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '746522fa663e452a8dc8e027d4ada53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130aaa9f8cfd4f4da3ea514336679ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:21:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Successfully created port: 8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Successfully updated port: 8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquired lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-changed-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Refreshing instance network info cache due to event network-changed-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] Acquiring lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Releasing lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] Acquired lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.neutron [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Refreshing network info cache for port 8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converting VIF {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG os_vif [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae0deadd-52af-5ed6-a1df-836c35b238cd', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bdb2f4e-29, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bdb2f4e-29, col_values=(('qos', UUID('38854b7c-3e61-40a2-9e22-be652175c498')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bdb2f4e-29, col_values=(('external_ids', {'iface-id': '8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:00:0a', 'vm-uuid': 'ee67f6fa-6b81-46b5-a3cc-ef756c0ad477'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:37 user nova-compute[74131]: INFO os_vif [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29')
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converting VIF {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] attach device xml: <interface type="ethernet">
Oct 20 16:21:37 user nova-compute[74131]:   <mac address="fa:16:3e:3b:00:0a"/>
Oct 20 16:21:37 user nova-compute[74131]:   <model type="virtio"/>
Oct 20 16:21:37 user nova-compute[74131]:   <mtu size="1442"/>
Oct 20 16:21:37 user nova-compute[74131]:   <target dev="tap8bdb2f4e-29"/>
Oct 20 16:21:37 user nova-compute[74131]: </interface>
Oct 20 16:21:37 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:21:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-5aa44967-a807-4004-aea4-ca5bc6dfd9c5 req-e22ef4de-1999-45a3-bf50-539d4aa1dc28 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5aa44967-a807-4004-aea4-ca5bc6dfd9c5 req-e22ef4de-1999-45a3-bf50-539d4aa1dc28 service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5aa44967-a807-4004-aea4-ca5bc6dfd9c5 req-e22ef4de-1999-45a3-bf50-539d4aa1dc28 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5aa44967-a807-4004-aea4-ca5bc6dfd9c5 req-e22ef4de-1999-45a3-bf50-539d4aa1dc28 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-5aa44967-a807-4004-aea4-ca5bc6dfd9c5 req-e22ef4de-1999-45a3-bf50-539d4aa1dc28 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:21:38 user nova-compute[74131]: WARNING nova.compute.manager [req-5aa44967-a807-4004-aea4-ca5bc6dfd9c5 req-e22ef4de-1999-45a3-bf50-539d4aa1dc28 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received unexpected event network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce for instance with vm_state active and task_state None.
Oct 20 16:21:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No BDM found with device name hda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No VIF found with MAC fa:16:3e:7f:40:bb, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:21:38 user nova-compute[74131]:   <nova:package version="0.0.0"/>
Oct 20 16:21:38 user nova-compute[74131]:   <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:21:38 user nova-compute[74131]:   <nova:creationTime>2023-10-20 16:21:38</nova:creationTime>
Oct 20 16:21:38 user nova-compute[74131]:   <nova:flavor name="m1.tiny">
Oct 20 16:21:38 user nova-compute[74131]:     <nova:memory>512</nova:memory>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:disk>1</nova:disk>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:swap>0</nova:swap>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:vcpus>1</nova:vcpus>
Oct 20 16:21:38 user nova-compute[74131]:   </nova:flavor>
Oct 20 16:21:38 user nova-compute[74131]:   <nova:owner>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:21:38 user nova-compute[74131]:   </nova:owner>
Oct 20 16:21:38 user nova-compute[74131]:   <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:21:38 user nova-compute[74131]:   <nova:ports>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:21:38 user nova-compute[74131]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:21:38 user nova-compute[74131]:     </nova:port>
Oct 20 16:21:38 user nova-compute[74131]:     <nova:port uuid="8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce">
Oct 20 16:21:38 user nova-compute[74131]:       <nova:ip type="fixed" address="10.10.10.181" ipVersion="4"/>
Oct 20 16:21:38 user nova-compute[74131]:     </nova:port>
Oct 20 16:21:38 user nova-compute[74131]:   </nova:ports>
Oct 20 16:21:38 user nova-compute[74131]: </nova:instance>
Oct 20 16:21:38 user nova-compute[74131]:  {{(pid=74131) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab26b598-cce6-4d80-b4b8-de624bbaacb4 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "interface-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.445s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updated VIF entry in instance network info cache for port 8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-19889781-f803-4fb1-bd2f-ac2ae2acfe26 req-91ca3514-4158-46d1-989b-833559bac648 service nova] Releasing lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-changed-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Refreshing instance network info cache due to event network-changed-7b9444f6-ea43-4322-9c80-b9d7988f8f5b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] Acquiring lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] Acquired lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Refreshing network info cache for port 7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updated VIF entry in instance network info cache for port 7b9444f6-ea43-4322-9c80-b9d7988f8f5b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updating instance_info_cache with network_info: [{"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c7c0991f-b766-48af-9683-0d5439ca6639 req-fdb55106-91f4-49a3-bfee-815b58e92971 service nova] Releasing lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-652f5943-58fc-485f-81f6-b06884e981d9 req-52fa2fa1-5463-4426-93ff-156d01359f85 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-652f5943-58fc-485f-81f6-b06884e981d9 req-52fa2fa1-5463-4426-93ff-156d01359f85 service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-652f5943-58fc-485f-81f6-b06884e981d9 req-52fa2fa1-5463-4426-93ff-156d01359f85 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-652f5943-58fc-485f-81f6-b06884e981d9 req-52fa2fa1-5463-4426-93ff-156d01359f85 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-652f5943-58fc-485f-81f6-b06884e981d9 req-52fa2fa1-5463-4426-93ff-156d01359f85 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:21:40 user nova-compute[74131]: WARNING nova.compute.manager [req-652f5943-58fc-485f-81f6-b06884e981d9 req-52fa2fa1-5463-4426-93ff-156d01359f85 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received unexpected event network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce for instance with vm_state active and task_state None.
Oct 20 16:21:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-changed-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Refreshing instance network info cache due to event network-changed-08dbda12-aa82-450d-abd5-87e218a4bc78. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] Acquiring lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] Acquired lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Refreshing network info cache for port 08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updated VIF entry in instance network info cache for port 08dbda12-aa82-450d-abd5-87e218a4bc78. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updating instance_info_cache with network_info: [{"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5ed70545-73e2-46d5-8687-44fb696f7ed9 req-e5d9ae9e-fd0f-41c4-afb7-30c995f2f6a2 service nova] Releasing lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXlURnEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:21:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:21:50 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723e3b6-4662-4518-af5c-308d22eeb713]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:21:50 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3411d05b-a16f-4198-956a-37e68a05f2d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9] added
Oct 20 16:21:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a5b50-13be-4971-a9f1-5513fe83d97f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[899ae523-5c7c-4496-a5f9-2ad630858c7c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXlURnEP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXlURnEP" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1aaabe-62c2-497e-bde6-6f6deb049347]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXlURnEP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'flavor' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[152aa889-5bc6-4b86-a6ef-0c4d7efbaaed]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd584b3-60c9-419d-bf9e-da7df01ea705]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:21:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:21:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lazy-loading 'flavor' on Instance uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54e9838-a6e0-4497-a2d4-d4a88d730418]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260]
Oct 20 16:21:50 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260] successful.
Oct 20 16:21:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed4bb0f-7e01-4e26-9f4f-8509b1ba5ea9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[de53fb63-2316-4db9-8ac8-2f6715ad9081]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:21:50 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:21:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:21:50 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:21:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4d3c1c-c453-4719-8034-171063b32bf9]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXlURnEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.utils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b6f11-081a-491a-8eeb-7eb8c799a06d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cdcc12-da08-45f3-a9a9-916589cef663]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d35202b-4ba2-48fd-948d-a606c7ee04e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdac37a-cdfb-4dac-b3b4-f7a9173b9144]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:50 user nova-compute[74131]: INFO nova.virt.block_device [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Booting with volume 51957990-4701-49da-825a-08348c95dfd6 at /dev/vdb
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:50 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2e7e2-a8f3-4376-beec-1f4415408ce1]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG os_brick.utils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating existing volume attachment record: c8ae033e-a9c5-4973-8be5-d3b1407d82fd {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:50 user nova-compute[74131]: INFO nova.compute.manager [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Attaching volume 995a799a-54e5-4b04-9d0d-94e9f710830c to /dev/vdb
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:21:51 user nova-compute[74131]: INFO nova.compute.manager [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Attaching volume 119f7808-e6ad-43ab-abca-8c214cc87240 to /dev/vdb
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53e20d-aee1-4ff1-b7e9-b8ff9f2ac4c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77e7096-e746-4932-a784-0e6120d0a506]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3891beb1-44c3-40c3-9ea0-bd141359683d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1802ae35-4786-4cbf-8426-888c97a04361]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:51 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce3836f-43d9-4d1f-a0b7-c8c807a01925]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating existing volume attachment record: 97b38fda-f071-4501-8b5b-c07396fa5779 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd39612-2cac-4848-b7bb-af3f1c406d93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cbef50-1239-4655-8c56-9d4e38691fba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.049s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7057d309-8c5c-473f-936e-7ac8006d92c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9ec82-ff61-4033-8b04-cd58da52ef5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7194e5-8937-4181-ba6f-59003945d98e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee1864-a917-4861-8a88-ed6bb0f0f32c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[966c1aed-c820-4885-9be2-174d4fd24c0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a0f185-c40f-4c9e-9187-849f0b29fd21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:51 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d6a10-b843-434b-b013-3f478ac65740]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] <== get_connector_properties: return (365ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating existing volume attachment record: 72df9a6d-07e0-4817-a853-b5bfafd88885 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26437666362343765', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437666362343765', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:21:51 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:21:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9b2646-53cc-4a93-b4d8-1d61bee5f30a]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] <== get_connector_properties: return (247ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updating existing volume attachment record: 0941646b-7929-48bc-b7f7-160ec73585ae {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG nova.objects.instance [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lazy-loading 'flavor' on Instance uuid 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:21:51 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:21:51 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:21:51 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:21:51 user nova-compute[74131]:   <serial>e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9</serial>
Oct 20 16:21:51 user nova-compute[74131]: </disk>
Oct 20 16:21:51 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-changed-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Refreshing instance network info cache due to event network-changed-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] Acquiring lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] Acquired lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Refreshing network info cache for port 29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] No VIF found with MAC fa:16:3e:2a:6f:cd, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Updated VIF entry in instance network info cache for port 29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Updating instance_info_cache with network_info: [{"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0debc966-2a6b-496f-b109-079bfa17562a req-f7bc40af-a65a-49f5-bb66-f48950d6b07a service nova] Releasing lock "refresh_cache-fe867561-330e-4ccd-a012-46d4420bcbaf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:21:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:21:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMAzHhfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:10 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[521edb7f-2d61-4be0-872a-2936d1c65764]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:10 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f40f67-f4b7-449b-a4db-beeaf320ed4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63] added
Oct 20 16:22:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3abf2a-4a0d-4fc9-a4ca-7f23fff887b2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3208b8cd-9f9d-4718-9763-867c6b5c1816]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMAzHhfZ {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMAzHhfZ" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[30609d7e-2a46-4e2d-97aa-3d2b41943c12]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMAzHhfZ'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f9543d-9ff8-4a37-97d3-ce975ac8661e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf09e5c-7067-4cbc-aa68-9e7da79835ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a07ce26-f11e-46a3-a943-4e63b8c79a60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260]
Oct 20 16:22:10 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad3e3a3-fc6d-44af-9e0b-380a13d52933]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c56aae-971d-41ed-89aa-dd06f865c231]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a78e39-b6fd-4092-8710-5321515c7de6]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMAzHhfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-315e4bb5-d387-42ab-8f0e-c810fa2ab309 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.296s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lazy-loading 'flavor' on Instance uuid fe867561-330e-4ccd-a012-46d4420bcbaf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:10 user nova-compute[74131]: INFO nova.virt.block_device [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Booting with volume d794f8fe-7f1c-4789-9e40-fed18c0a9e29 at /dev/vdc
Oct 20 16:22:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:11 user nova-compute[74131]: INFO nova.virt.block_device [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Booting with volume 16bb4d5e-217e-44db-a958-95bc2287c734 at /dev/vdc
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lazy-loading 'flavor' on Instance uuid eea7c78b-928f-4e65-956a-cb57026ef891 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23635346130383061', 'path': '/dev/sdd'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635346130383061', 'path': '/dev/sdd'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:22:11 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:11 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:22:11 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:22:11 user nova-compute[74131]:   <serial>387825ee-5645-4ed4-9f4a-0eec9182ec63</serial>
Oct 20 16:22:11 user nova-compute[74131]: </disk>
Oct 20 16:22:11 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.utils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed89eca-55a5-4701-9ac6-e16b8bd17a41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eed4f18-fdca-44a6-a22b-c72301a59e3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0aaa0-271b-42ac-bba8-361aa057cfd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f3cc0a-d7cb-478e-b691-297a28380f61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:11 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa33812-8639-4152-a559-4a96eec752f3]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.utils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating existing volume attachment record: e1501ae3-0b21-4a15-81d2-42cc417fa7b2 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:11 user nova-compute[74131]: INFO nova.compute.manager [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Attaching volume e3fec81f-4e5c-4565-bb16-166252e0812d to /dev/vdb
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:11 user nova-compute[74131]: INFO nova.compute.manager [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Terminating instance
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.utils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:11 user nova-compute[74131]: INFO nova.compute.manager [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Attaching volume 3d74096c-47c0-477b-b3e7-52af8addd9e0 to /dev/sdc
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed928c6-4db0-4be5-8f85-4fc663232993]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[001bc36f-cbfd-4a78-bf28-36597e556e16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2041cfc-de51-4f68-b987-56db61c0d0a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[60414238-cdff-482c-afb5-9f977653755d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:11 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[314a7afa-7dd3-4a2e-9e24-9d002f59246e]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG os_brick.utils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating existing volume attachment record: f704b2d9-6e1e-472e-ae81-1196cc0d545d {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No VIF found with MAC fa:16:3e:3b:0b:93, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:22:11 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-4fb19d23-3082-482a-a6be-5ecef4898053 req-58d83bb9-8659-46f5-bacc-dbdc221e4118 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received event network-vif-unplugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4fb19d23-3082-482a-a6be-5ecef4898053 req-58d83bb9-8659-46f5-bacc-dbdc221e4118 service nova] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4fb19d23-3082-482a-a6be-5ecef4898053 req-58d83bb9-8659-46f5-bacc-dbdc221e4118 service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4fb19d23-3082-482a-a6be-5ecef4898053 req-58d83bb9-8659-46f5-bacc-dbdc221e4118 service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-4fb19d23-3082-482a-a6be-5ecef4898053 req-58d83bb9-8659-46f5-bacc-dbdc221e4118 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] No waiting events found dispatching network-vif-unplugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-4fb19d23-3082-482a-a6be-5ecef4898053 req-58d83bb9-8659-46f5-bacc-dbdc221e4118 service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received event network-vif-unplugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:22:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Instance destroyed successfully.
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.objects.instance [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lazy-loading 'resources' on Instance uuid 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-802960042',display_name='tempest-DeleteServersTestJSON-server-802960042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-802960042',id=1,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64918c14577b454999d913ff4275f54b',ramdisk_id='',reservation_id='r-f0o1fdp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1971082525',owner_user_name='tempest-DeleteServersTestJSON-1971082525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:28Z,user_data=None,user_id='4dcc4ddad51a4b988b44161b0c56c067',uuid=1889a30c-75e7-452a-b804-3dc6a2d5b2d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Converting VIF {"id": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "address": "fa:16:3e:2a:6f:cd", "network": {"id": "27714657-d1fb-4b5e-8821-1b1c1b4ec548", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-850938448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64918c14577b454999d913ff4275f54b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5629fc1b-8b", "ovs_interfaceid": "5629fc1b-8b41-4636-a91e-9c735124cfd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:6f:cd,bridge_name='br-int',has_traffic_filtering=True,id=5629fc1b-8b41-4636-a91e-9c735124cfd4,network=Network(27714657-d1fb-4b5e-8821-1b1c1b4ec548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5629fc1b-8b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_vif [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:6f:cd,bridge_name='br-int',has_traffic_filtering=True,id=5629fc1b-8b41-4636-a91e-9c735124cfd4,network=Network(27714657-d1fb-4b5e-8821-1b1c1b4ec548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5629fc1b-8b') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5629fc1b-8b, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aa7e90a-fbdf-4cfb-bd86-25d94f15ccbd) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:12 user nova-compute[74131]: INFO os_vif [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:6f:cd,bridge_name='br-int',has_traffic_filtering=True,id=5629fc1b-8b41-4636-a91e-9c735124cfd4,network=Network(27714657-d1fb-4b5e-8821-1b1c1b4ec548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5629fc1b-8b')
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXlURnEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:12 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ae954-c54c-4a58-99dd-15b31557e25a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:22:12 user nova-compute[74131]: No targets found.
Oct 20 16:22:12 user nova-compute[74131]: iSNS:
Oct 20 16:22:12 user nova-compute[74131]: No targets found.
Oct 20 16:22:12 user nova-compute[74131]: STATIC:
Oct 20 16:22:12 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9
Oct 20 16:22:12 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:12 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:12 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:22:12 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:12 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:12 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:22:12 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:12 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:12 user nova-compute[74131]: FIRMWARE:
Oct 20 16:22:12 user nova-compute[74131]: No targets found.
Oct 20 16:22:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:22:12 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:22:12 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da5e39-bc11-45e9-bc5c-2e950978c98c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6278832e-ddf0-4374-aa37-ffaf42f37a08]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:12 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:22:12 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:12 user nova-compute[74131]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 (non-flash)
Oct 20 16:22:12 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c859f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9'): ({'sdc'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Removing single pathed devices sdc {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[306337fb-736d-483a-94ab-4e15426bb55c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c4a72-ac63-4eac-9be5-9afc85efc28a]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Flushing IO for device /dev/sdc {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d75c65-61d8-441c-b3c8-f316f0ac9d83]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e79747-9d6d-4757-9993-f60e59677a6a]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf6a1d-f8e2-4eaf-97d9-2ace0746f484]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e59e9a5-70a1-4110-8b01-bcc6fbdd22c2]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260]
Oct 20 16:22:12 user nova-compute[74131]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21f2bef-eebe-4a6e-bdf5-f6895fc64aa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb30a6c-67aa-491e-95a6-de0d39c7eb9c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] <== disconnect_volume: return (326ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:22:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Deleting instance files /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9_del
Oct 20 16:22:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Deletion of /opt/stack/data/nova/instances/1889a30c-75e7-452a-b804-3dc6a2d5b2d9_del complete
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74131) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 16:22:12 user nova-compute[74131]: INFO nova.virt.libvirt.host [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] UEFI support detected
Oct 20 16:22:12 user nova-compute[74131]: INFO nova.compute.manager [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MweBtSxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:12 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:12 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:12 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36b3556-cd8f-4fcc-b506-64af5e2bdbf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:13 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c23c7b3-bb30-4033-92f9-d46eb777bbeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c] added
Oct 20 16:22:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd925f80-c90a-4910-821b-e0e3d9f0797c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939819b-b3c1-4b23-91b8-81761acee692]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MweBtSxr {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MweBtSxr" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6710647f-0420-4847-bdc8-005c47392941]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MweBtSxr'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ce73ff-acb2-4f25-bba5-726103c75fbc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6416b262-9190-45de-8eca-99d77417c50e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[80115c37-6f20-4949-a13b-358e7dc69ba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260]
Oct 20 16:22:13 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c33daf-058e-4ae2-aff6-942b042e6cdd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e901274-4b50-4b02-8a94-47b676e45cd8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:13 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96bc941-f61f-46b4-be78-f18b4d16cd21]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:14 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Took 1.10 seconds to deallocate network for instance.
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecb6cbe1-5cb7-41fd-a306-894b0e44fae2 req-08d22f7d-b3f1-475a-addb-9e62ab01d34c service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received event network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecb6cbe1-5cb7-41fd-a306-894b0e44fae2 req-08d22f7d-b3f1-475a-addb-9e62ab01d34c service nova] Acquiring lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecb6cbe1-5cb7-41fd-a306-894b0e44fae2 req-08d22f7d-b3f1-475a-addb-9e62ab01d34c service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecb6cbe1-5cb7-41fd-a306-894b0e44fae2 req-08d22f7d-b3f1-475a-addb-9e62ab01d34c service nova] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecb6cbe1-5cb7-41fd-a306-894b0e44fae2 req-08d22f7d-b3f1-475a-addb-9e62ab01d34c service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] No waiting events found dispatching network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:14 user nova-compute[74131]: WARNING nova.compute.manager [req-ecb6cbe1-5cb7-41fd-a306-894b0e44fae2 req-08d22f7d-b3f1-475a-addb-9e62ab01d34c service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received unexpected event network-vif-plugged-5629fc1b-8b41-4636-a91e-9c735124cfd4 for instance with vm_state active and task_state deleting.
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecb6cbe1-5cb7-41fd-a306-894b0e44fae2 req-08d22f7d-b3f1-475a-addb-9e62ab01d34c service nova] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Received event network-vif-deleted-5629fc1b-8b41-4636-a91e-9c735124cfd4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MweBtSxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23738386230323261', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738386230323261', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'flavor' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:22:14 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:14 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:22:14 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:22:14 user nova-compute[74131]:   <serial>995a799a-54e5-4b04-9d0d-94e9f710830c</serial>
Oct 20 16:22:14 user nova-compute[74131]: </disk>
Oct 20 16:22:14 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No BDM found with device name hda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] No VIF found with MAC fa:16:3e:7f:40:bb, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:22:16 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:16 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7745MB free_disk=25.56020736694336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1889a30c-75e7-452a-b804-3dc6a2d5b2d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3e22a492-a812-415d-92c1-3cc51b842cc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance eea7c78b-928f-4e65-956a-cb57026ef891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6f5e776-329d-4e3c-a18c-ca4a01789def actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance fe867561-330e-4ccd-a012-46d4420bcbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5b627751-886a-4ae3-8027-d48db36f8269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d2f0a264-c008-4a8d-a043-e3d391371e03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3308d7fc-97c0-4491-89da-b2c764637509 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:22:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:22:17 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:22:17 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:22:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:22:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:22:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-changed-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Refreshing instance network info cache due to event network-changed-c9e6dc02-3b44-4572-ba36-213377f08203. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:22:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] Acquiring lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:22:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] Acquired lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:22:25 user nova-compute[74131]: DEBUG nova.network.neutron [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Refreshing network info cache for port c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:22:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updated VIF entry in instance network info cache for port c9e6dc02-3b44-4572-ba36-213377f08203. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:22:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updating instance_info_cache with network_info: [{"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:22:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-740d2af7-8680-4e35-86e0-e59cbbff344e req-acbde629-81e9-49f4-aa24-645fe1b21ee8 service nova] Releasing lock "refresh_cache-d2f0a264-c008-4a8d-a043-e3d391371e03" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:22:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:31 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:31 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:31 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d979db37-5513-4e57-9d5a-b9703f45b564]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:31 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0f2d9-45ce-4060-b460-37255f4bd0cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240] added
Oct 20 16:22:31 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bbb3db-2e9b-4b38-b0cc-f80a10d0e9a2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4f27fafe-c0ba-4469-948c-4aec9baa1617 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.325s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[034bab64-e572-49b1-a46e-98a83522023f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLJxhMYF {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLJxhMYF" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c423349d-e330-4fae-bf50-b611dfa78963]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLJxhMYF'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06d72a7-1de3-4c8d-89c9-5a8630ea6a4e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b075bd84-d605-4c40-9ef9-4452f2020a3b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:31 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:31 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e46957c-adb9-4832-a5f2-88aaa3ef7cbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]
Oct 20 16:22:31 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:31 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea91fe70-b6c3-4717-a56f-ab463e46b924]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9ce5f8-78e3-4883-ac8d-d0e9ecd7b34c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:31 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:31 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f359e057-1d9a-4c9d-b942-37d824d5b101]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.utils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47159e8-134e-482f-873d-d88f88000101]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b900b01-6e7a-4db5-ac48-7f65f00784fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.utils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1eea6-c451-4f07-8e09-705a00ef504a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a74ec-db55-45aa-9dbb-c8ec43d341bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd6a74d-9b1d-45d6-a560-f1c157a68403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:31 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d524087-e0ca-41d5-913f-97df5cbe14d0]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.utils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updating existing volume attachment record: 7ae3381a-994d-4f71-9bef-55952a8e6646 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a12c11-20d7-42c5-aae3-53ee540b2373]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7550c2d2-3203-4a6b-acb1-b1e2dc4f2478]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ea4a0-d8d6-4b72-87bd-192012e866f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:31 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:22:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[15591891-e523-456d-8654-56fa48ebbdc4]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG os_brick.utils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:31 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Updating existing volume attachment record: 56614f5a-cdd2-4dd7-86a5-e9c3b4301432 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a2b9de9-0bab-40f1-9256-34f2159f221b tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.534s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23138623235353966', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138623235353966', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lazy-loading 'flavor' on Instance uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:22:32 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:32 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:22:32 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:22:32 user nova-compute[74131]:   <serial>119f7808-e6ad-43ab-abca-8c214cc87240</serial>
Oct 20 16:22:32 user nova-compute[74131]: </disk>
Oct 20 16:22:32 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:22:32 user nova-compute[74131]: INFO nova.compute.manager [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] [instance: 1889a30c-75e7-452a-b804-3dc6a2d5b2d9] Took 18.73 seconds to detach 1 volumes for instance.
Oct 20 16:22:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] No VIF found with MAC fa:16:3e:ab:6d:2f, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:33 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:22:33 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:22:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.642s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:33 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Deleted allocations for instance 1889a30c-75e7-452a-b804-3dc6a2d5b2d9
Oct 20 16:22:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3dd04562-9205-4260-b0bc-e0379ffd5fa4 tempest-DeleteServersTestJSON-1971082525 tempest-DeleteServersTestJSON-1971082525-project-member] Lock "1889a30c-75e7-452a-b804-3dc6a2d5b2d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.069s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:22:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Creating image(s)
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Ensure instance console log exists: /opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Start _get_guest_xml network_info=[{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7edc88e4-98f3-4b25-8b7c-ea903b65f429', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdmNWEpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd32cf37-0b04-47c4-8220-5be5ba52521b', 'serial': 'bd32cf37-0b04-47c4-8220-5be5ba52521b'}, 'volume_type': None}, {'attachment_id': '834921e8-3966-4ec2-a6b9-5a84c32a47de', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imNXVHud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca', 'attached_at': '', 'detached_at': '', 'volume_id': '196a2605-accd-4a03-9534-4de4793e2192', 'serial': '196a2605-accd-4a03-9534-4de4793e2192'}, 'volume_type': None}, {'attachment_id': 'e1501ae3-0b21-4a15-81d2-42cc417fa7b2', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkXVzyjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'd794f8fe-7f1c-4789-9e40-fed18c0a9e29', 'serial': 'd794f8fe-7f1c-4789-9e40-fed18c0a9e29'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:22:34 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:34 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdmNWEpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:34 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:34 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:34 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f823a2-3d12-4702-a106-fe6438e93d3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:34 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae737d-f821-4963-b3c5-5ec22639681d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b] added
Oct 20 16:22:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f6f0e-7ce4-43a1-83c9-a63f0b3655ce]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace6ee2-b3ca-4a65-9f27-f0b4fbbb8cd7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdmNWEpA {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdmNWEpA" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c347d1a-020f-4e3e-b8d0-922fdf776fbb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YdmNWEpA'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc59ab-2d10-4114-a628-00680e101422]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd691bc-9168-4dcc-8625-841f7b9ae568]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfb8006f-ba89-42d3-a328-638506ca966c tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.327s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5344316-c6ce-408c-a711-fa696ae95cba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260]
Oct 20 16:22:34 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3241b0-865b-4a6a-baa2-3c90b3c5822c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4678cd3-d70d-4351-9113-2c0692692940]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:34 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50831e6-edf7-4679-8cf8-dee9883e6703]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdmNWEpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:22:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Creating image(s)
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Ensure instance console log exists: /opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Start _get_guest_xml network_info=[{"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '381e2ff0-9249-4eea-8f4b-50a4eb7d5604', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBCatUTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3308d7fc-97c0-4491-89da-b2c764637509', 'attached_at': '', 'detached_at': '', 'volume_id': '217944a7-0357-4339-84be-09d598f35aad', 'serial': '217944a7-0357-4339-84be-09d598f35aad'}, 'volume_type': None}, {'attachment_id': '97b38fda-f071-4501-8b5b-c07396fa5779', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBdpbPwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3308d7fc-97c0-4491-89da-b2c764637509', 'attached_at': '', 'detached_at': '', 'volume_id': '51957990-4701-49da-825a-08348c95dfd6', 'serial': '51957990-4701-49da-825a-08348c95dfd6'}, 'volume_type': None}, {'attachment_id': 'f704b2d9-6e1e-472e-ae81-1196cc0d545d', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIhlrQxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3308d7fc-97c0-4491-89da-b2c764637509', 'attached_at': '', 'detached_at': '', 'volume_id': '16bb4d5e-217e-44db-a958-95bc2287c734', 'serial': '16bb4d5e-217e-44db-a958-95bc2287c734'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:22:34 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:34 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBCatUTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:34 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:34 user nova-compute[74131]: INFO nova.compute.manager [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Rebuilding instance
Oct 20 16:22:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-d407ee89-fa7b-4988-9ed5-cc259971f035 req-3fa8c0b3-ed42-41a7-a276-50e3242b9e9e service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-unplugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d407ee89-fa7b-4988-9ed5-cc259971f035 req-3fa8c0b3-ed42-41a7-a276-50e3242b9e9e service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d407ee89-fa7b-4988-9ed5-cc259971f035 req-3fa8c0b3-ed42-41a7-a276-50e3242b9e9e service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d407ee89-fa7b-4988-9ed5-cc259971f035 req-3fa8c0b3-ed42-41a7-a276-50e3242b9e9e service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-d407ee89-fa7b-4988-9ed5-cc259971f035 req-3fa8c0b3-ed42-41a7-a276-50e3242b9e9e service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-unplugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:35 user nova-compute[74131]: WARNING nova.compute.manager [req-d407ee89-fa7b-4988-9ed5-cc259971f035 req-3fa8c0b3-ed42-41a7-a276-50e3242b9e9e service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received unexpected event network-vif-unplugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with vm_state active and task_state rebuilding.
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23565343539356263', 'path': '/dev/sdf'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565343539356263', 'path': '/dev/sdf'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.889s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:35 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:35 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[342b82e1-7972-4d77-810d-3b8f14044221]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:35 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imNXVHud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:35 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d5b97-6282-4434-ac66-da4d4e2a9658]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad] added
Oct 20 16:22:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed77c5d1-5b46-46fe-a758-01b7ee856a07]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[891a6e9e-497f-44df-8431-a65dc1610cff]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBCatUTj {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBCatUTj" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2367b9-cf37-4b3d-9bf4-a140a37f9b0a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NBCatUTj'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a1aba5-be56-4b22-acda-c89efd7df8cb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbc2ac6-ddb3-47a0-bf2f-20be69816259]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3418d02-d2c0-468f-bfed-8fdd2b5814fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260]
Oct 20 16:22:35 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.046s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e51871c-9dd8-4dad-a3a9-886c7f6f05cc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:35 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance destroyed successfully.
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c95670-d8a6-44d5-93e1-1755f3996b1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:35 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:35 user nova-compute[74131]: INFO nova.compute.manager [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Detaching volume 995a799a-54e5-4b04-9d0d-94e9f710830c
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a388bb-a932-4919-9fdb-9a946553dbdd]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBCatUTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance destroyed successfully.
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1685753138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2143544802',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc4XMoxY4Dg+61kJ87kel36Y/5nH7VTQZrzEJv51BivlA49XZaf3Bj9QPbaGeYwls5bkzRLFgBw92nCYLyRqtpE8UqiU8SJyy2XjeM7IMfT3Enbm1zJVOMIEoid2i/ueQ==',key_name='tempest-keypair-694396898',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='271c255eceee494a88cb94ce0782cdac',ramdisk_id='',reservation_id='r-kb184yfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153044646',owner_user_name='tempest-ServerActionsV293TestJSON-153044646-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:22:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7afdf3b099374db9a370162d951c9f9c',uuid=d2f0a264-c008-4a8d-a043-e3d391371e03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converting VIF {"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_vif [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9e6dc02-3b, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a754da2-46e8-48fd-b2c1-a8c039d9fad9) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:36 user nova-compute[74131]: INFO os_vif [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b')
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:36 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:36 user nova-compute[74131]: INFO nova.virt.block_device [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Attempting to driver detach volume 995a799a-54e5-4b04-9d0d-94e9f710830c from mountpoint /dev/vdb
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Attempting to detach device vdb from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:22:36 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:36 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:22:36 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:22:36 user nova-compute[74131]:   <serial>995a799a-54e5-4b04-9d0d-94e9f710830c</serial>
Oct 20 16:22:36 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 16:22:36 user nova-compute[74131]: </disk>
Oct 20 16:22:36 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:22:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully detached device vdb from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the persistent domain config.
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:22:36 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:36 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:22:36 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:22:36 user nova-compute[74131]:   <serial>995a799a-54e5-4b04-9d0d-94e9f710830c</serial>
Oct 20 16:22:36 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 16:22:36 user nova-compute[74131]: </disk>
Oct 20 16:22:36 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.utils [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4436a70-dafb-4e0f-a343-50c242227578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db67269-32f8-42ba-b064-358435a6f9c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc4f105-da5f-46cd-8b93-3e199cc70e14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e78e123-a3a5-421d-b935-4fc943440fb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:22:36 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:22:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2dc6df-58c5-431a-8694-4357a69c059e]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:22:36 user nova-compute[74131]: DEBUG os_brick.utils [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:36 user nova-compute[74131]: INFO nova.compute.manager [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Swapping volume 119f7808-e6ad-43ab-abca-8c214cc87240 for 2839858f-1ded-44ed-bf91-69da4885562c
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== connect_volume: return (2346ms) {'type': 'block', 'scsi_wwn': '23132363234626138', 'path': '/dev/sdg'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132363234626138', 'path': '/dev/sdg'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.384s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:37 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:37 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f8867e-8156-4316-b249-94951c0e0df4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:37 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBdpbPwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:37 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf68810e-9c83-4c29-b834-b7984146721d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192] added
Oct 20 16:22:37 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3a05a9-cb5c-42d9-80fc-b57b7e930133]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f568b6a2-9f68-453d-9ee6-4d1112babcc5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imNXVHud {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imNXVHud" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0957f2d6-9902-4d1c-9f6f-3942f28edde7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'imNXVHud'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:22:37 user nova-compute[74131]: INFO nova.compute.claims [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Claim successful on node user
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fb5bee-7772-4390-a66e-1dcb4ad3357d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e22df8-09dd-4eb0-ad85-f72e51e15020]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:37 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:37 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3742ff55-af6b-4947-bf63-8b3d613f739a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260]
Oct 20 16:22:37 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:37 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f0e0b1-0f3c-4279-be01-abad7166865b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aec9a61-71de-43fa-8d76-09dd66f81e76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:37 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:37 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[227181df-cdcf-465c-bee1-bf808df0f513]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-3961039d-00df-4d2b-9688-ea5a8e87615f req-b21d863a-06f9-418f-9205-4b8c647c6d8d service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3961039d-00df-4d2b-9688-ea5a8e87615f req-b21d863a-06f9-418f-9205-4b8c647c6d8d service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3961039d-00df-4d2b-9688-ea5a8e87615f req-b21d863a-06f9-418f-9205-4b8c647c6d8d service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3961039d-00df-4d2b-9688-ea5a8e87615f req-b21d863a-06f9-418f-9205-4b8c647c6d8d service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-3961039d-00df-4d2b-9688-ea5a8e87615f req-b21d863a-06f9-418f-9205-4b8c647c6d8d service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:37 user nova-compute[74131]: WARNING nova.compute.manager [req-3961039d-00df-4d2b-9688-ea5a8e87615f req-b21d863a-06f9-418f-9205-4b8c647c6d8d service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received unexpected event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with vm_state active and task_state rebuilding.
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:22:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.policy [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79db1d105a6e406a965eb94987fdfaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac73a0c54fb4583aec623c4c7528428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:22:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Creating image(s)
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "/opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imNXVHud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== connect_volume: return (2843ms) {'type': 'block', 'scsi_wwn': '23330366663363361', 'path': '/dev/sdh'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330366663363361', 'path': '/dev/sdh'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.421s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8e20f-e30a-4b67-a6e6-b40abd378d24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:22:38 user nova-compute[74131]: No targets found.
Oct 20 16:22:38 user nova-compute[74131]: iSNS:
Oct 20 16:22:38 user nova-compute[74131]: No targets found.
Oct 20 16:22:38 user nova-compute[74131]: STATIC:
Oct 20 16:22:38 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:22:38 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:38 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:38 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c
Oct 20 16:22:38 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:38 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:38 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:22:38 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:38 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:38 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:22:38 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:38 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:38 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:22:38 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:38 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:38 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:22:38 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:38 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:38 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:22:38 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:38 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:38 user nova-compute[74131]: FIRMWARE:
Oct 20 16:22:38 user nova-compute[74131]: No targets found.
Oct 20 16:22:38 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:22:38 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:22:38 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e4e135-498a-471a-9d81-778039561346]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[621eba3d-0b2d-421e-9fab-836428736ce3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:38 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:38 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c840fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[64522492-c49c-41b9-ac38-d14d292d2997]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[394ce375-70c0-4625-9bca-9e6c8a32341e]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdb528e-67a3-4bb7-a1be-739d3bc186cd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b74a8-a99a-4b13-923e-5f80bc33497d]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk 1073741824" returned: 0 in 0.346s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.549s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fad096-1877-4c7d-a273-9f907af0d25b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkXVzyjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:38 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Successfully created port: 0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd3539b-c187-44a1-be4d-7f579a3128f6]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]
Oct 20 16:22:38 user nova-compute[74131]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:38 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5941f97-18f1-4b66-882d-1569274ba276]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] <== disconnect_volume: return (2861ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:22:38 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Deleting instance files /opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03_del
Oct 20 16:22:38 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Deletion of /opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03_del complete
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.876s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:38 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:38 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.227s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a2a9b-dabe-4988-90be-616ae96fcae7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:38 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3343819-9818-46ec-994a-3cc1655bd63c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6] added
Oct 20 16:22:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111d765-86db-4479-afaa-2942fc009291]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1d88f3-7b60-48ec-9710-b17e570379e7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBdpbPwq {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBdpbPwq" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e229ffc8-dab0-4003-bbbf-2c6eb2b775f1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sBdpbPwq'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba326e4-c73e-4cc4-8a5c-03cb9d5afeb6]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Cannot resize image /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Ensure instance console log exists: /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c047e2-5c33-4974-af4f-fcb3f1dd317c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf4c5f8-5491-4523-ba3e-a0badc6a3965]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260]
Oct 20 16:22:39 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74662f5-fa5c-42c3-bde1-67012089f71f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f945f-402b-4126-8a28-06f4659a767a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:39 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d6479-0a1d-4acb-8ed6-7a3d4f5e5746]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Successfully updated port: 0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquired lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-changed-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Refreshing instance network info cache due to event network-changed-0532a160-3c88-4853-83ce-a1fe7b648d22. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] Acquiring lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Updating instance_info_cache with network_info: [{"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Releasing lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Instance network_info: |[{"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] Acquired lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Refreshing network info cache for port 0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Start _get_guest_xml network_info=[{"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:22:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-306988643',display_name='tempest-AttachVolumeNegativeTest-server-306988643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-306988643',id=12,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc9h69YrUjj330jdlyuYiprSMjgBTlFqJxih7vZT0m1UOR1Z90VQg+ho8+sWv+L52dYiD5xnTMBVss3tY5kjFW+FlWYpXY27ZXewyv1tmK+g0lKn0Cz5msI6HFAvh1jWA==',key_name='tempest-keypair-1118395557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-d52h726u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:11:b9,bridge_name='br-int',has_traffic_filtering=True,id=0532a160-3c88-4853-83ce-a1fe7b648d22,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0532a160-3c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.objects.instance [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'pci_devices' on Instance uuid 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:22:39 user nova-compute[74131]:   <uuid>20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74</uuid>
Oct 20 16:22:39 user nova-compute[74131]:   <name>instance-0000000c</name>
Oct 20 16:22:39 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:22:39 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:22:39 user nova-compute[74131]:   <metadata>
Oct 20 16:22:39 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:22:39 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:22:39 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeNegativeTest-server-306988643</nova:name>
Oct 20 16:22:39 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:22:39</nova:creationTime>
Oct 20 16:22:39 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:22:39 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:22:39 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:22:39 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:22:39 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:22:39 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:22:39 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:22:39 user nova-compute[74131]:       <nova:owner>
Oct 20 16:22:39 user nova-compute[74131]:         <nova:user uuid="79db1d105a6e406a965eb94987fdfaf3">tempest-AttachVolumeNegativeTest-395634699-project-member</nova:user>
Oct 20 16:22:39 user nova-compute[74131]:         <nova:project uuid="3ac73a0c54fb4583aec623c4c7528428">tempest-AttachVolumeNegativeTest-395634699</nova:project>
Oct 20 16:22:39 user nova-compute[74131]:       </nova:owner>
Oct 20 16:22:39 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:22:39 user nova-compute[74131]:       <nova:ports>
Oct 20 16:22:39 user nova-compute[74131]:         <nova:port uuid="0532a160-3c88-4853-83ce-a1fe7b648d22">
Oct 20 16:22:39 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 16:22:39 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:39 user nova-compute[74131]:       </nova:ports>
Oct 20 16:22:39 user nova-compute[74131]:     </nova:instance>
Oct 20 16:22:39 user nova-compute[74131]:   </metadata>
Oct 20 16:22:39 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:22:39 user nova-compute[74131]:     <system>
Oct 20 16:22:39 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:22:39 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:22:39 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:22:39 user nova-compute[74131]:       <entry name="serial">20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74</entry>
Oct 20 16:22:39 user nova-compute[74131]:       <entry name="uuid">20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74</entry>
Oct 20 16:22:39 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:22:39 user nova-compute[74131]:     </system>
Oct 20 16:22:39 user nova-compute[74131]:   </sysinfo>
Oct 20 16:22:39 user nova-compute[74131]:   <os>
Oct 20 16:22:39 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:22:39 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:22:39 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:22:39 user nova-compute[74131]:   </os>
Oct 20 16:22:39 user nova-compute[74131]:   <features>
Oct 20 16:22:39 user nova-compute[74131]:     <acpi/>
Oct 20 16:22:39 user nova-compute[74131]:     <apic/>
Oct 20 16:22:39 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:22:39 user nova-compute[74131]:   </features>
Oct 20 16:22:39 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:22:39 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:22:39 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:22:39 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:22:39 user nova-compute[74131]:   </clock>
Oct 20 16:22:39 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:22:39 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:22:39 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:22:39 user nova-compute[74131]:   </cpu>
Oct 20 16:22:39 user nova-compute[74131]:   <devices>
Oct 20 16:22:39 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:22:39 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:22:39 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk"/>
Oct 20 16:22:39 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:22:39 user nova-compute[74131]:     </disk>
Oct 20 16:22:39 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:39 user nova-compute[74131]:       <mac address="fa:16:3e:ab:11:b9"/>
Oct 20 16:22:39 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:39 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:39 user nova-compute[74131]:       <target dev="tap0532a160-3c"/>
Oct 20 16:22:39 user nova-compute[74131]:     </interface>
Oct 20 16:22:39 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:22:39 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/console.log" append="off"/>
Oct 20 16:22:39 user nova-compute[74131]:     </serial>
Oct 20 16:22:39 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:22:39 user nova-compute[74131]:     <video>
Oct 20 16:22:39 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:39 user nova-compute[74131]:     </video>
Oct 20 16:22:39 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:22:39 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:22:39 user nova-compute[74131]:     </rng>
Oct 20 16:22:39 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:22:39 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:22:39 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:22:39 user nova-compute[74131]:     </memballoon>
Oct 20 16:22:39 user nova-compute[74131]:   </devices>
Oct 20 16:22:39 user nova-compute[74131]: </domain>
Oct 20 16:22:39 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-306988643',display_name='tempest-AttachVolumeNegativeTest-server-306988643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-306988643',id=12,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc9h69YrUjj330jdlyuYiprSMjgBTlFqJxih7vZT0m1UOR1Z90VQg+ho8+sWv+L52dYiD5xnTMBVss3tY5kjFW+FlWYpXY27ZXewyv1tmK+g0lKn0Cz5msI6HFAvh1jWA==',key_name='tempest-keypair-1118395557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-d52h726u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:11:b9,bridge_name='br-int',has_traffic_filtering=True,id=0532a160-3c88-4853-83ce-a1fe7b648d22,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0532a160-3c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG os_vif [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:11:b9,bridge_name='br-int',has_traffic_filtering=True,id=0532a160-3c88-4853-83ce-a1fe7b648d22,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0532a160-3c') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e129a06a-d9b5-5608-9485-30ea6a9ce529', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0532a160-3c, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0532a160-3c, col_values=(('qos', UUID('715edac7-e7a1-4348-b721-55adce1ca4e8')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0532a160-3c, col_values=(('external_ids', {'iface-id': '0532a160-3c88-4853-83ce-a1fe7b648d22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:11:b9', 'vm-uuid': '20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:39 user nova-compute[74131]: INFO os_vif [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:11:b9,bridge_name='br-int',has_traffic_filtering=True,id=0532a160-3c88-4853-83ce-a1fe7b648d22,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0532a160-3c')
Oct 20 16:22:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No VIF found with MAC fa:16:3e:ab:11:b9, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG nova.network.neutron [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Updated VIF entry in instance network info cache for port 0532a160-3c88-4853-83ce-a1fe7b648d22. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG nova.network.neutron [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Updating instance_info_cache with network_info: [{"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dc91b597-cf21-4ba2-af88-d5b665123f25 req-1d157d7a-825e-44dd-8024-502e67996960 service nova] Releasing lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBdpbPwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== connect_volume: return (3280ms) {'type': 'block', 'scsi_wwn': '23165366338613833', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165366338613833', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.561s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:40 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:40 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29a504b-40a8-4dfc-a816-79d81d4c06a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:40 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIhlrQxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:40 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdc2717-6107-4340-b06c-6a28ca652acb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29] added
Oct 20 16:22:40 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3741ee3c-51e5-401a-a1e8-bb54e1e5804d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a986d1-7f0c-4274-a17d-0569657d3a0f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkXVzyjx {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkXVzyjx" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce914be1-9812-4f61-98ca-87e28817417f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkXVzyjx'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf00b1a-3615-4068-9b86-baeeefb13ad0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0745a191-7e5e-4f90-a40f-988a4ba6a46a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[70497dba-a48e-4997-a5d9-c1b834871893]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260]
Oct 20 16:22:40 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:40 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b956966a-0967-4ea6-b5a1-827048d98c87]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbda9a19-3157-49cc-b50f-5964d5df7849]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:40 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:40 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[910e422b-a3a2-4063-8b3e-4f079ffa6f74]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:40 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkXVzyjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-ec997415-9116-41df-9ea9-63aa33523589 req-999c58c3-f91d-49b9-87e6-11c08515f1d8 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ec997415-9116-41df-9ea9-63aa33523589 req-999c58c3-f91d-49b9-87e6-11c08515f1d8 service nova] Acquiring lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ec997415-9116-41df-9ea9-63aa33523589 req-999c58c3-f91d-49b9-87e6-11c08515f1d8 service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ec997415-9116-41df-9ea9-63aa33523589 req-999c58c3-f91d-49b9-87e6-11c08515f1d8 service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-ec997415-9116-41df-9ea9-63aa33523589 req-999c58c3-f91d-49b9-87e6-11c08515f1d8 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] No waiting events found dispatching network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:41 user nova-compute[74131]: WARNING nova.compute.manager [req-ec997415-9116-41df-9ea9-63aa33523589 req-999c58c3-f91d-49b9-87e6-11c08515f1d8 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received unexpected event network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 for instance with vm_state building and task_state spawning.
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== connect_volume: return (2934ms) {'type': 'block', 'scsi_wwn': '26631303636343330', 'path': '/dev/sdi'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631303636343330', 'path': '/dev/sdi'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.343s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:41 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:41 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0f7683-a328-4169-a106-a1a8ab6d1160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:41 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:13,bridge_name='br-int',has_traffic_filtering=True,id=99757533-e66b-4bc8-97d0-7d48f34782bf,network=Network(f76591c7-6b7b-4f84-b36a-73c78453670a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99757533-e6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:07:87,bridge_name='br-int',has_traffic_filtering=True,id=5c568f79-cd10-49f5-83a9-b3c375a11c51,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c568f79-cd') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b2:98,bridge_name='br-int',has_traffic_filtering=True,id=a5c275f1-5b09-4cf8-8590-8971595a828c,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c275f1-5b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=a156a317-1011-417d-b4da-199d79eca471,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa156a317-10') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:a7:71,bridge_name='br-int',has_traffic_filtering=True,id=a146d40a-536f-4bec-8a48-d162c51c818e,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa146d40a-53') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:42:cf,bridge_name='br-int',has_traffic_filtering=True,id=a567a97b-c472-4481-97db-7d7a4ef92ec1,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa567a97b-c4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a8:15,bridge_name='br-int',has_traffic_filtering=True,id=c1f7bff5-067d-4e94-9703-b3a03102c6bb,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f7bff5-06') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.objects.instance [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lazy-loading 'pci_devices' on Instance uuid a6903514-5d6a-4954-bb2d-a5da5d5624ca {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dfebe4-a4f9-4a5e-b3a8-a92922356b23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734] added
Oct 20 16:22:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[449e7420-205c-4d1d-b812-ab3dff1f43ae]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:22:41 user nova-compute[74131]:   <uuid>a6903514-5d6a-4954-bb2d-a5da5d5624ca</uuid>
Oct 20 16:22:41 user nova-compute[74131]:   <name>instance-00000009</name>
Oct 20 16:22:41 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:22:41 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:22:41 user nova-compute[74131]:   <metadata>
Oct 20 16:22:41 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:22:41 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:22:41 user nova-compute[74131]:       <nova:name>tempest-device-tagging-server-1570442189</nova:name>
Oct 20 16:22:41 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:22:34</nova:creationTime>
Oct 20 16:22:41 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:22:41 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:22:41 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:22:41 user nova-compute[74131]:       <nova:owner>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:user uuid="3a9c73d128c04e65a98bf1beb30b5a94">tempest-TaggedBootDevicesTest_v242-1757416359-project-member</nova:user>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:project uuid="7731c7dd721a4ffca10b9a305aedc1e6">tempest-TaggedBootDevicesTest_v242-1757416359</nova:project>
Oct 20 16:22:41 user nova-compute[74131]:       </nova:owner>
Oct 20 16:22:41 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:22:41 user nova-compute[74131]:       <nova:ports>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:port uuid="99757533-e66b-4bc8-97d0-7d48f34782bf">
Oct 20 16:22:41 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 16:22:41 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:port uuid="5c568f79-cd10-49f5-83a9-b3c375a11c51">
Oct 20 16:22:41 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Oct 20 16:22:41 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:port uuid="a5c275f1-5b09-4cf8-8590-8971595a828c">
Oct 20 16:22:41 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
Oct 20 16:22:41 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:port uuid="a156a317-1011-417d-b4da-199d79eca471">
Oct 20 16:22:41 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Oct 20 16:22:41 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:port uuid="a146d40a-536f-4bec-8a48-d162c51c818e">
Oct 20 16:22:41 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Oct 20 16:22:41 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:port uuid="a567a97b-c472-4481-97db-7d7a4ef92ec1">
Oct 20 16:22:41 user nova-compute[74131]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 16:22:41 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:41 user nova-compute[74131]:         <nova:port uuid="c1f7bff5-067d-4e94-9703-b3a03102c6bb">
Oct 20 16:22:41 user nova-compute[74131]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 16:22:41 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:41 user nova-compute[74131]:       </nova:ports>
Oct 20 16:22:41 user nova-compute[74131]:     </nova:instance>
Oct 20 16:22:41 user nova-compute[74131]:   </metadata>
Oct 20 16:22:41 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:22:41 user nova-compute[74131]:     <system>
Oct 20 16:22:41 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:22:41 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:22:41 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:22:41 user nova-compute[74131]:       <entry name="serial">a6903514-5d6a-4954-bb2d-a5da5d5624ca</entry>
Oct 20 16:22:41 user nova-compute[74131]:       <entry name="uuid">a6903514-5d6a-4954-bb2d-a5da5d5624ca</entry>
Oct 20 16:22:41 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:22:41 user nova-compute[74131]:     </system>
Oct 20 16:22:41 user nova-compute[74131]:   </sysinfo>
Oct 20 16:22:41 user nova-compute[74131]:   <os>
Oct 20 16:22:41 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:22:41 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:22:41 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:22:41 user nova-compute[74131]:   </os>
Oct 20 16:22:41 user nova-compute[74131]:   <features>
Oct 20 16:22:41 user nova-compute[74131]:     <acpi/>
Oct 20 16:22:41 user nova-compute[74131]:     <apic/>
Oct 20 16:22:41 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:22:41 user nova-compute[74131]:   </features>
Oct 20 16:22:41 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:22:41 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:22:41 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:22:41 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:22:41 user nova-compute[74131]:   </clock>
Oct 20 16:22:41 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:22:41 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:22:41 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:22:41 user nova-compute[74131]:   </cpu>
Oct 20 16:22:41 user nova-compute[74131]:   <devices>
Oct 20 16:22:41 user nova-compute[74131]:     <disk type="file" device="cdrom">
Oct 20 16:22:41 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 16:22:41 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca/disk.config"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="hda" bus="ide"/>
Oct 20 16:22:41 user nova-compute[74131]:     </disk>
Oct 20 16:22:41 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:22:41 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:41 user nova-compute[74131]:       <source dev="/dev/sdf"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <serial>bd32cf37-0b04-47c4-8220-5be5ba52521b</serial>
Oct 20 16:22:41 user nova-compute[74131]:     </disk>
Oct 20 16:22:41 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:22:41 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:41 user nova-compute[74131]:       <source dev="/dev/sdh"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <serial>196a2605-accd-4a03-9534-4de4793e2192</serial>
Oct 20 16:22:41 user nova-compute[74131]:     </disk>
Oct 20 16:22:41 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:22:41 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:41 user nova-compute[74131]:       <source dev="/dev/sdi"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="vdc" bus="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <serial>d794f8fe-7f1c-4789-9e40-fed18c0a9e29</serial>
Oct 20 16:22:41 user nova-compute[74131]:     </disk>
Oct 20 16:22:41 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:41 user nova-compute[74131]:       <mac address="fa:16:3e:28:e7:13"/>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="tap99757533-e6"/>
Oct 20 16:22:41 user nova-compute[74131]:     </interface>
Oct 20 16:22:41 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:41 user nova-compute[74131]:       <mac address="fa:16:3e:04:07:87"/>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="tap5c568f79-cd"/>
Oct 20 16:22:41 user nova-compute[74131]:     </interface>
Oct 20 16:22:41 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:41 user nova-compute[74131]:       <mac address="fa:16:3e:98:b2:98"/>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="tapa5c275f1-5b"/>
Oct 20 16:22:41 user nova-compute[74131]:     </interface>
Oct 20 16:22:41 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:41 user nova-compute[74131]:       <mac address="fa:16:3e:20:43:c2"/>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="tapa156a317-10"/>
Oct 20 16:22:41 user nova-compute[74131]:     </interface>
Oct 20 16:22:41 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:41 user nova-compute[74131]:       <mac address="fa:16:3e:01:a7:71"/>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="tapa146d40a-53"/>
Oct 20 16:22:41 user nova-compute[74131]:     </interface>
Oct 20 16:22:41 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:41 user nova-compute[74131]:       <mac address="fa:16:3e:6b:42:cf"/>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="tapa567a97b-c4"/>
Oct 20 16:22:41 user nova-compute[74131]:     </interface>
Oct 20 16:22:41 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:41 user nova-compute[74131]:       <mac address="fa:16:3e:17:a8:15"/>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:41 user nova-compute[74131]:       <target dev="tapc1f7bff5-06"/>
Oct 20 16:22:41 user nova-compute[74131]:     </interface>
Oct 20 16:22:41 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:22:41 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca/console.log" append="off"/>
Oct 20 16:22:41 user nova-compute[74131]:     </serial>
Oct 20 16:22:41 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:22:41 user nova-compute[74131]:     <video>
Oct 20 16:22:41 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:41 user nova-compute[74131]:     </video>
Oct 20 16:22:41 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:22:41 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:22:41 user nova-compute[74131]:     </rng>
Oct 20 16:22:41 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:22:41 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:22:41 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:22:41 user nova-compute[74131]:     </memballoon>
Oct 20 16:22:41 user nova-compute[74131]:   </devices>
Oct 20 16:22:41 user nova-compute[74131]: </domain>
Oct 20 16:22:41 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:13,bridge_name='br-int',has_traffic_filtering=True,id=99757533-e66b-4bc8-97d0-7d48f34782bf,network=Network(f76591c7-6b7b-4f84-b36a-73c78453670a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99757533-e6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:13,bridge_name='br-int',has_traffic_filtering=True,id=99757533-e66b-4bc8-97d0-7d48f34782bf,network=Network(f76591c7-6b7b-4f84-b36a-73c78453670a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99757533-e6') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '008a8172-5a62-507d-be9b-6cbfa01613f8', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99757533-e6, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99757533-e6, col_values=(('qos', UUID('2c706ff7-c475-4b76-9fad-bbe4622296e2')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99757533-e6, col_values=(('external_ids', {'iface-id': '99757533-e66b-4bc8-97d0-7d48f34782bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e7:13', 'vm-uuid': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db3c59a-6e23-4bf9-bf4f-c1a013a6a4fe]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIhlrQxs {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: INFO os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:13,bridge_name='br-int',has_traffic_filtering=True,id=99757533-e66b-4bc8-97d0-7d48f34782bf,network=Network(f76591c7-6b7b-4f84-b36a-73c78453670a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99757533-e6')
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:07:87,bridge_name='br-int',has_traffic_filtering=True,id=5c568f79-cd10-49f5-83a9-b3c375a11c51,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c568f79-cd') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:07:87,bridge_name='br-int',has_traffic_filtering=True,id=5c568f79-cd10-49f5-83a9-b3c375a11c51,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c568f79-cd') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a11a0522-7e01-5ac4-8954-028bd6eefc26', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIhlrQxs" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d439e7-2bce-4d8e-981e-24d854c5eab4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mIhlrQxs'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c568f79-cd, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c568f79-cd, col_values=(('qos', UUID('571005bc-9c0f-412d-88e2-1c2fc18539e5')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c568f79-cd, col_values=(('external_ids', {'iface-id': '5c568f79-cd10-49f5-83a9-b3c375a11c51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:07:87', 'vm-uuid': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc602e-c5e4-4201-8b6a-f69d17b8459d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: INFO os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:07:87,bridge_name='br-int',has_traffic_filtering=True,id=5c568f79-cd10-49f5-83a9-b3c375a11c51,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c568f79-cd')
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b2:98,bridge_name='br-int',has_traffic_filtering=True,id=a5c275f1-5b09-4cf8-8590-8971595a828c,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c275f1-5b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b2:98,bridge_name='br-int',has_traffic_filtering=True,id=a5c275f1-5b09-4cf8-8590-8971595a828c,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c275f1-5b') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '312e87b5-43ab-5814-a441-f034fbe9b8f4', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5ec6d-8b2e-4abb-ab89-e59ce871b670]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:41 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5c275f1-5b, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5c275f1-5b, col_values=(('qos', UUID('4c2e6942-d64c-4988-b8bc-0b39937849cc')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5c275f1-5b, col_values=(('external_ids', {'iface-id': 'a5c275f1-5b09-4cf8-8590-8971595a828c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:b2:98', 'vm-uuid': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: INFO os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b2:98,bridge_name='br-int',has_traffic_filtering=True,id=a5c275f1-5b09-4cf8-8590-8971595a828c,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c275f1-5b')
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=a156a317-1011-417d-b4da-199d79eca471,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa156a317-10') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=a156a317-1011-417d-b4da-199d79eca471,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa156a317-10') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa2fa195-e857-5493-940b-cae15da37756', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0765444f-7239-429c-b3fd-e5bc33539a14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260]
Oct 20 16:22:42 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:42 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa156a317-10, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa156a317-10, col_values=(('qos', UUID('706979a9-03d4-4142-8f8c-a598857f9f85')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa156a317-10, col_values=(('external_ids', {'iface-id': 'a156a317-1011-417d-b4da-199d79eca471', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:43:c2', 'vm-uuid': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2c429c-ebe0-4bea-b8d2-4adee211bd0e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: INFO os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=a156a317-1011-417d-b4da-199d79eca471,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa156a317-10')
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:a7:71,bridge_name='br-int',has_traffic_filtering=True,id=a146d40a-536f-4bec-8a48-d162c51c818e,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa146d40a-53') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:a7:71,bridge_name='br-int',has_traffic_filtering=True,id=a146d40a-536f-4bec-8a48-d162c51c818e,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa146d40a-53') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6ca7b81-7f98-50b6-89b5-d64795691bce', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f773b57f-98c0-440d-bdf3-caf57143a75d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:42 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:42 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c53f50d-8745-4121-9db9-6ef72f1de3af]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIhlrQxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa146d40a-53, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa146d40a-53, col_values=(('qos', UUID('992f1710-3b82-4b03-98c0-29b9c0d5ce40')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa146d40a-53, col_values=(('external_ids', {'iface-id': 'a146d40a-536f-4bec-8a48-d162c51c818e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:a7:71', 'vm-uuid': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: INFO os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:a7:71,bridge_name='br-int',has_traffic_filtering=True,id=a146d40a-536f-4bec-8a48-d162c51c818e,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa146d40a-53')
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:42:cf,bridge_name='br-int',has_traffic_filtering=True,id=a567a97b-c472-4481-97db-7d7a4ef92ec1,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa567a97b-c4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:42:cf,bridge_name='br-int',has_traffic_filtering=True,id=a567a97b-c472-4481-97db-7d7a4ef92ec1,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa567a97b-c4') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f07aa3b-baaa-5dff-becc-b4f288607e76', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa567a97b-c4, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa567a97b-c4, col_values=(('qos', UUID('1baa6179-c788-425a-ae1b-e8e06ef6181f')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa567a97b-c4, col_values=(('external_ids', {'iface-id': 'a567a97b-c472-4481-97db-7d7a4ef92ec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:42:cf', 'vm-uuid': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: INFO os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:42:cf,bridge_name='br-int',has_traffic_filtering=True,id=a567a97b-c472-4481-97db-7d7a4ef92ec1,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa567a97b-c4')
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a8:15,bridge_name='br-int',has_traffic_filtering=True,id=c1f7bff5-067d-4e94-9703-b3a03102c6bb,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f7bff5-06') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a8:15,bridge_name='br-int',has_traffic_filtering=True,id=c1f7bff5-067d-4e94-9703-b3a03102c6bb,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f7bff5-06') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39f26b6c-86bd-5c0d-839f-82e1ebe3d960', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1f7bff5-06, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1f7bff5-06, col_values=(('qos', UUID('e60f2706-f361-44ca-9db6-610aee1c2556')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1f7bff5-06, col_values=(('external_ids', {'iface-id': 'c1f7bff5-067d-4e94-9703-b3a03102c6bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:a8:15', 'vm-uuid': 'a6903514-5d6a-4954-bb2d-a5da5d5624ca'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:42 user nova-compute[74131]: INFO os_vif [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a8:15,bridge_name='br-int',has_traffic_filtering=True,id=c1f7bff5-067d-4e94-9703-b3a03102c6bb,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f7bff5-06')
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] No BDM found with device name hda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] No VIF found with MAC fa:16:3e:28:e7:13, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] No VIF found with MAC fa:16:3e:01:a7:71, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Using config drive
Oct 20 16:22:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Creating config drive at /opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca/disk.config
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprf9pvxsy {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprf9pvxsy" returned: 0 in 0.071s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== connect_volume: return (2831ms) {'type': 'block', 'scsi_wwn': '23664316635643032', 'path': '/dev/sdj'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664316635643032', 'path': '/dev/sdj'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b4:46,bridge_name='br-int',has_traffic_filtering=True,id=1bf41897-28d2-4330-9306-804c943a8411,network=Network(2fd9399b-b8f9-4756-80c7-dfae9c8e6edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf41897-28') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:7d:13,bridge_name='br-int',has_traffic_filtering=True,id=7c4de563-daf8-46aa-9b5b-23c9e24bcee2,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c4de563-da') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8c:e5,bridge_name='br-int',has_traffic_filtering=True,id=f51a05ea-ef40-44f9-a969-6e9e420590bb,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf51a05ea-ef') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b5:67,bridge_name='br-int',has_traffic_filtering=True,id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf300e70d-b3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:c8,bridge_name='br-int',has_traffic_filtering=True,id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a14a4e6-3a') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:7c,bridge_name='br-int',has_traffic_filtering=True,id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c9b25b-7d') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:3e,bridge_name='br-int',has_traffic_filtering=True,id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped445149-84') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lazy-loading 'pci_devices' on Instance uuid 3308d7fc-97c0-4491-89da-b2c764637509 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:22:43 user nova-compute[74131]:   <uuid>3308d7fc-97c0-4491-89da-b2c764637509</uuid>
Oct 20 16:22:43 user nova-compute[74131]:   <name>instance-0000000a</name>
Oct 20 16:22:43 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:22:43 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:22:43 user nova-compute[74131]:   <metadata>
Oct 20 16:22:43 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:22:43 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:22:43 user nova-compute[74131]:       <nova:name>tempest-device-tagging-server-1703448913</nova:name>
Oct 20 16:22:43 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:22:34</nova:creationTime>
Oct 20 16:22:43 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:22:43 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:22:43 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:22:43 user nova-compute[74131]:       <nova:owner>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:user uuid="e9802f39e1c04548b788f94302d2406f">tempest-TaggedBootDevicesTest-183686554-project-member</nova:user>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:project uuid="54ffe9b3287344cb979587e0f18bc99d">tempest-TaggedBootDevicesTest-183686554</nova:project>
Oct 20 16:22:43 user nova-compute[74131]:       </nova:owner>
Oct 20 16:22:43 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:22:43 user nova-compute[74131]:       <nova:ports>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:port uuid="1bf41897-28d2-4330-9306-804c943a8411">
Oct 20 16:22:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 16:22:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:port uuid="7c4de563-daf8-46aa-9b5b-23c9e24bcee2">
Oct 20 16:22:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Oct 20 16:22:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:port uuid="f51a05ea-ef40-44f9-a969-6e9e420590bb">
Oct 20 16:22:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Oct 20 16:22:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:port uuid="f300e70d-b38f-4f63-be92-3ec0c30ee8dc">
Oct 20 16:22:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Oct 20 16:22:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:port uuid="5a14a4e6-3aa5-43cb-9559-0f2bff7b2020">
Oct 20 16:22:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Oct 20 16:22:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:port uuid="d6c9b25b-7ddc-447e-9571-c1a727de3f8e">
Oct 20 16:22:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 16:22:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:43 user nova-compute[74131]:         <nova:port uuid="ed445149-84d5-4acc-9ce3-d0d0a264cfc3">
Oct 20 16:22:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 16:22:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:22:43 user nova-compute[74131]:       </nova:ports>
Oct 20 16:22:43 user nova-compute[74131]:     </nova:instance>
Oct 20 16:22:43 user nova-compute[74131]:   </metadata>
Oct 20 16:22:43 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:22:43 user nova-compute[74131]:     <system>
Oct 20 16:22:43 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:22:43 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:22:43 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:22:43 user nova-compute[74131]:       <entry name="serial">3308d7fc-97c0-4491-89da-b2c764637509</entry>
Oct 20 16:22:43 user nova-compute[74131]:       <entry name="uuid">3308d7fc-97c0-4491-89da-b2c764637509</entry>
Oct 20 16:22:43 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:22:43 user nova-compute[74131]:     </system>
Oct 20 16:22:43 user nova-compute[74131]:   </sysinfo>
Oct 20 16:22:43 user nova-compute[74131]:   <os>
Oct 20 16:22:43 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:22:43 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:22:43 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:22:43 user nova-compute[74131]:   </os>
Oct 20 16:22:43 user nova-compute[74131]:   <features>
Oct 20 16:22:43 user nova-compute[74131]:     <acpi/>
Oct 20 16:22:43 user nova-compute[74131]:     <apic/>
Oct 20 16:22:43 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:22:43 user nova-compute[74131]:   </features>
Oct 20 16:22:43 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:22:43 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:22:43 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:22:43 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:22:43 user nova-compute[74131]:   </clock>
Oct 20 16:22:43 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:22:43 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:22:43 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:22:43 user nova-compute[74131]:   </cpu>
Oct 20 16:22:43 user nova-compute[74131]:   <devices>
Oct 20 16:22:43 user nova-compute[74131]:     <disk type="file" device="cdrom">
Oct 20 16:22:43 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 16:22:43 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509/disk.config"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="hda" bus="ide"/>
Oct 20 16:22:43 user nova-compute[74131]:     </disk>
Oct 20 16:22:43 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:22:43 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:43 user nova-compute[74131]:       <source dev="/dev/sdg"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <serial>217944a7-0357-4339-84be-09d598f35aad</serial>
Oct 20 16:22:43 user nova-compute[74131]:     </disk>
Oct 20 16:22:43 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:22:43 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:43 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <serial>51957990-4701-49da-825a-08348c95dfd6</serial>
Oct 20 16:22:43 user nova-compute[74131]:     </disk>
Oct 20 16:22:43 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:22:43 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:43 user nova-compute[74131]:       <source dev="/dev/sdj"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="vdc" bus="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <serial>16bb4d5e-217e-44db-a958-95bc2287c734</serial>
Oct 20 16:22:43 user nova-compute[74131]:     </disk>
Oct 20 16:22:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:43 user nova-compute[74131]:       <mac address="fa:16:3e:64:b4:46"/>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="tap1bf41897-28"/>
Oct 20 16:22:43 user nova-compute[74131]:     </interface>
Oct 20 16:22:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:43 user nova-compute[74131]:       <mac address="fa:16:3e:66:7d:13"/>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="tap7c4de563-da"/>
Oct 20 16:22:43 user nova-compute[74131]:     </interface>
Oct 20 16:22:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:43 user nova-compute[74131]:       <mac address="fa:16:3e:d4:8c:e5"/>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="tapf51a05ea-ef"/>
Oct 20 16:22:43 user nova-compute[74131]:     </interface>
Oct 20 16:22:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:43 user nova-compute[74131]:       <mac address="fa:16:3e:c8:b5:67"/>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="tapf300e70d-b3"/>
Oct 20 16:22:43 user nova-compute[74131]:     </interface>
Oct 20 16:22:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:43 user nova-compute[74131]:       <mac address="fa:16:3e:45:05:c8"/>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="tap5a14a4e6-3a"/>
Oct 20 16:22:43 user nova-compute[74131]:     </interface>
Oct 20 16:22:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:43 user nova-compute[74131]:       <mac address="fa:16:3e:d9:9d:7c"/>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="tapd6c9b25b-7d"/>
Oct 20 16:22:43 user nova-compute[74131]:     </interface>
Oct 20 16:22:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:22:43 user nova-compute[74131]:       <mac address="fa:16:3e:81:7f:3e"/>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:22:43 user nova-compute[74131]:       <target dev="taped445149-84"/>
Oct 20 16:22:43 user nova-compute[74131]:     </interface>
Oct 20 16:22:43 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:22:43 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509/console.log" append="off"/>
Oct 20 16:22:43 user nova-compute[74131]:     </serial>
Oct 20 16:22:43 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:22:43 user nova-compute[74131]:     <video>
Oct 20 16:22:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:22:43 user nova-compute[74131]:     </video>
Oct 20 16:22:43 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:22:43 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:22:43 user nova-compute[74131]:     </rng>
Oct 20 16:22:43 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:22:43 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:22:43 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:22:43 user nova-compute[74131]:     </memballoon>
Oct 20 16:22:43 user nova-compute[74131]:   </devices>
Oct 20 16:22:43 user nova-compute[74131]: </domain>
Oct 20 16:22:43 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b4:46,bridge_name='br-int',has_traffic_filtering=True,id=1bf41897-28d2-4330-9306-804c943a8411,network=Network(2fd9399b-b8f9-4756-80c7-dfae9c8e6edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf41897-28') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b4:46,bridge_name='br-int',has_traffic_filtering=True,id=1bf41897-28d2-4330-9306-804c943a8411,network=Network(2fd9399b-b8f9-4756-80c7-dfae9c8e6edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf41897-28') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53305bfb-1d78-55a1-b2bf-03bde059b2cd', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bf41897-28, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bf41897-28, col_values=(('qos', UUID('b2be149e-a6a4-43eb-a2b6-d8419b476d88')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bf41897-28, col_values=(('external_ids', {'iface-id': '1bf41897-28d2-4330-9306-804c943a8411', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:b4:46', 'vm-uuid': '3308d7fc-97c0-4491-89da-b2c764637509'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: INFO os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b4:46,bridge_name='br-int',has_traffic_filtering=True,id=1bf41897-28d2-4330-9306-804c943a8411,network=Network(2fd9399b-b8f9-4756-80c7-dfae9c8e6edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf41897-28')
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:7d:13,bridge_name='br-int',has_traffic_filtering=True,id=7c4de563-daf8-46aa-9b5b-23c9e24bcee2,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c4de563-da') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:7d:13,bridge_name='br-int',has_traffic_filtering=True,id=7c4de563-daf8-46aa-9b5b-23c9e24bcee2,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c4de563-da') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2548e583-73b0-56ca-8ffa-1a051a77dc66', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c4de563-da, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c4de563-da, col_values=(('qos', UUID('5da28ea7-fa83-4cc4-aec9-19a991d9b831')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c4de563-da, col_values=(('external_ids', {'iface-id': '7c4de563-daf8-46aa-9b5b-23c9e24bcee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:7d:13', 'vm-uuid': '3308d7fc-97c0-4491-89da-b2c764637509'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: INFO os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:7d:13,bridge_name='br-int',has_traffic_filtering=True,id=7c4de563-daf8-46aa-9b5b-23c9e24bcee2,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c4de563-da')
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8c:e5,bridge_name='br-int',has_traffic_filtering=True,id=f51a05ea-ef40-44f9-a969-6e9e420590bb,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf51a05ea-ef') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8c:e5,bridge_name='br-int',has_traffic_filtering=True,id=f51a05ea-ef40-44f9-a969-6e9e420590bb,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf51a05ea-ef') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2006b519-3490-563b-8fad-2eb0f6cee5b8', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-eb615fb5-8801-4eec-8959-16a009f3d20c req-ce229008-4dfe-45b2-aa09-08312be8aa9a service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-eb615fb5-8801-4eec-8959-16a009f3d20c req-ce229008-4dfe-45b2-aa09-08312be8aa9a service nova] Acquiring lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-eb615fb5-8801-4eec-8959-16a009f3d20c req-ce229008-4dfe-45b2-aa09-08312be8aa9a service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-eb615fb5-8801-4eec-8959-16a009f3d20c req-ce229008-4dfe-45b2-aa09-08312be8aa9a service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-eb615fb5-8801-4eec-8959-16a009f3d20c req-ce229008-4dfe-45b2-aa09-08312be8aa9a service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] No waiting events found dispatching network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:43 user nova-compute[74131]: WARNING nova.compute.manager [req-eb615fb5-8801-4eec-8959-16a009f3d20c req-ce229008-4dfe-45b2-aa09-08312be8aa9a service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received unexpected event network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 for instance with vm_state building and task_state spawning.
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf51a05ea-ef, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf51a05ea-ef, col_values=(('qos', UUID('7fbb17eb-21fa-419d-a221-ec6dd1bf472b')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf51a05ea-ef, col_values=(('external_ids', {'iface-id': 'f51a05ea-ef40-44f9-a969-6e9e420590bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:8c:e5', 'vm-uuid': '3308d7fc-97c0-4491-89da-b2c764637509'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Instance spawned successfully.
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: INFO os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8c:e5,bridge_name='br-int',has_traffic_filtering=True,id=f51a05ea-ef40-44f9-a969-6e9e420590bb,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf51a05ea-ef')
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b5:67,bridge_name='br-int',has_traffic_filtering=True,id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf300e70d-b3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b5:67,bridge_name='br-int',has_traffic_filtering=True,id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf300e70d-b3') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfdf6cad-04fb-5294-9b16-99fbf192b029', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:43 user nova-compute[74131]: INFO nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Took 5.97 seconds to spawn the instance on the hypervisor.
Oct 20 16:22:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf300e70d-b3, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf300e70d-b3, col_values=(('qos', UUID('0a0525f2-970d-4051-a07b-b0c8cba7c8e0')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf300e70d-b3, col_values=(('external_ids', {'iface-id': 'f300e70d-b38f-4f63-be92-3ec0c30ee8dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:b5:67', 'vm-uuid': '3308d7fc-97c0-4491-89da-b2c764637509'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:44 user nova-compute[74131]: INFO nova.compute.manager [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Took 6.90 seconds to build instance.
Oct 20 16:22:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77a98626-139c-4e3b-b8f0-d35fdf795b8f tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.019s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: INFO os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b5:67,bridge_name='br-int',has_traffic_filtering=True,id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf300e70d-b3')
Oct 20 16:22:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:c8,bridge_name='br-int',has_traffic_filtering=True,id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a14a4e6-3a') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:c8,bridge_name='br-int',has_traffic_filtering=True,id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a14a4e6-3a') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '525aa6b9-1f27-525b-adda-9ff992b1e76b', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a14a4e6-3a, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a14a4e6-3a, col_values=(('qos', UUID('efc818a4-db2f-4533-99a2-c3ed93c10a55')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a14a4e6-3a, col_values=(('external_ids', {'iface-id': '5a14a4e6-3aa5-43cb-9559-0f2bff7b2020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:05:c8', 'vm-uuid': '3308d7fc-97c0-4491-89da-b2c764637509'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: INFO os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:c8,bridge_name='br-int',has_traffic_filtering=True,id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a14a4e6-3a')
Oct 20 16:22:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:7c,bridge_name='br-int',has_traffic_filtering=True,id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c9b25b-7d') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:7c,bridge_name='br-int',has_traffic_filtering=True,id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c9b25b-7d') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7130cddd-faa6-59aa-a740-0d492925c929', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c9b25b-7d, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6c9b25b-7d, col_values=(('qos', UUID('6bafefc7-5aec-49f0-b185-d48ad7a6d1fa')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6c9b25b-7d, col_values=(('external_ids', {'iface-id': 'd6c9b25b-7ddc-447e-9571-c1a727de3f8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:9d:7c', 'vm-uuid': '3308d7fc-97c0-4491-89da-b2c764637509'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: INFO os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:7c,bridge_name='br-int',has_traffic_filtering=True,id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c9b25b-7d')
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:3e,bridge_name='br-int',has_traffic_filtering=True,id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped445149-84') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:3e,bridge_name='br-int',has_traffic_filtering=True,id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped445149-84') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cf2b739-52d9-5439-bbaf-1a5bc0e7352d', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped445149-84, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped445149-84, col_values=(('qos', UUID('dfda50ea-e510-469d-8a67-afcca309ec71')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped445149-84, col_values=(('external_ids', {'iface-id': 'ed445149-84d5-4acc-9ce3-d0d0a264cfc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:7f:3e', 'vm-uuid': '3308d7fc-97c0-4491-89da-b2c764637509'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: INFO os_vif [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:3e,bridge_name='br-int',has_traffic_filtering=True,id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped445149-84')
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-a50758f4-e9a1-4f98-96f9-5de2df371f93 req-875fd195-67c7-4ffe-a906-7aefcc6be0e1 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a50758f4-e9a1-4f98-96f9-5de2df371f93 req-875fd195-67c7-4ffe-a906-7aefcc6be0e1 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a50758f4-e9a1-4f98-96f9-5de2df371f93 req-875fd195-67c7-4ffe-a906-7aefcc6be0e1 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a50758f4-e9a1-4f98-96f9-5de2df371f93 req-875fd195-67c7-4ffe-a906-7aefcc6be0e1 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-a50758f4-e9a1-4f98-96f9-5de2df371f93 req-875fd195-67c7-4ffe-a906-7aefcc6be0e1 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:45 user nova-compute[74131]: WARNING nova.compute.manager [req-a50758f4-e9a1-4f98-96f9-5de2df371f93 req-875fd195-67c7-4ffe-a906-7aefcc6be0e1 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c for instance with vm_state building and task_state spawning.
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:45 user nova-compute[74131]: WARNING nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf for instance with vm_state building and task_state spawning.
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:45 user nova-compute[74131]: WARNING nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf for instance with vm_state building and task_state spawning.
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:45 user nova-compute[74131]: WARNING nova.compute.manager [req-63cc87c8-a685-4e63-8b4b-1334ab459aa6 req-7432371c-0ad5-4478-97a9-cdefa41da8d6 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 for instance with vm_state building and task_state spawning.
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] No BDM found with device name hda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] No VIF found with MAC fa:16:3e:64:b4:46, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] No VIF found with MAC fa:16:3e:45:05:c8, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Using config drive
Oct 20 16:22:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Creating config drive at /opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509/disk.config
Oct 20 16:22:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_efuvix1 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_efuvix1" returned: 0 in 0.066s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-87c02894-f709-4a3d-82bf-efad46ae287c req-94273e75-610c-443c-961b-9deb01d34dbc service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87c02894-f709-4a3d-82bf-efad46ae287c req-94273e75-610c-443c-961b-9deb01d34dbc service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87c02894-f709-4a3d-82bf-efad46ae287c req-94273e75-610c-443c-961b-9deb01d34dbc service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87c02894-f709-4a3d-82bf-efad46ae287c req-94273e75-610c-443c-961b-9deb01d34dbc service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-87c02894-f709-4a3d-82bf-efad46ae287c req-94273e75-610c-443c-961b-9deb01d34dbc service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:46 user nova-compute[74131]: WARNING nova.compute.manager [req-87c02894-f709-4a3d-82bf-efad46ae287c req-94273e75-610c-443c-961b-9deb01d34dbc service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 for instance with vm_state building and task_state spawning.
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-f10b7a2d-3e32-46f9-95bc-1394c409e1de req-f0ce97f7-24c0-4b1f-b934-cb28f781fb02 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f10b7a2d-3e32-46f9-95bc-1394c409e1de req-f0ce97f7-24c0-4b1f-b934-cb28f781fb02 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f10b7a2d-3e32-46f9-95bc-1394c409e1de req-f0ce97f7-24c0-4b1f-b934-cb28f781fb02 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f10b7a2d-3e32-46f9-95bc-1394c409e1de req-f0ce97f7-24c0-4b1f-b934-cb28f781fb02 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-f10b7a2d-3e32-46f9-95bc-1394c409e1de req-f0ce97f7-24c0-4b1f-b934-cb28f781fb02 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-f10b7a2d-3e32-46f9-95bc-1394c409e1de req-f0ce97f7-24c0-4b1f-b934-cb28f781fb02 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:47 user nova-compute[74131]: WARNING nova.compute.manager [req-c22c1e7f-1af7-448d-a322-54d0b24b8df4 req-8faea6cd-818f-40a2-a9e5-0bf4a4d559ae service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb for instance with vm_state building and task_state spawning.
Oct 20 16:22:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-80afff1a-9d97-45f4-bbef-766d6a76255f req-27f9350e-82a3-43a6-9a5b-a3e1487d0bc7 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-80afff1a-9d97-45f4-bbef-766d6a76255f req-27f9350e-82a3-43a6-9a5b-a3e1487d0bc7 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-80afff1a-9d97-45f4-bbef-766d6a76255f req-27f9350e-82a3-43a6-9a5b-a3e1487d0bc7 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-80afff1a-9d97-45f4-bbef-766d6a76255f req-27f9350e-82a3-43a6-9a5b-a3e1487d0bc7 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-80afff1a-9d97-45f4-bbef-766d6a76255f req-27f9350e-82a3-43a6-9a5b-a3e1487d0bc7 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:48 user nova-compute[74131]: WARNING nova.compute.manager [req-80afff1a-9d97-45f4-bbef-766d6a76255f req-27f9350e-82a3-43a6-9a5b-a3e1487d0bc7 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 for instance with vm_state building and task_state spawning.
Oct 20 16:22:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:49 user nova-compute[74131]: WARNING nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 for instance with vm_state building and task_state spawning.
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:49 user nova-compute[74131]: WARNING nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 for instance with vm_state building and task_state spawning.
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:49 user nova-compute[74131]: WARNING nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 for instance with vm_state building and task_state spawning.
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:49 user nova-compute[74131]: WARNING nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 for instance with vm_state building and task_state spawning.
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:49 user nova-compute[74131]: WARNING nova.compute.manager [req-c9bc2118-be60-4f65-8b08-37490a0de914 req-40ffd22e-fd1f-4f36-b0a2-bf2dc5aeb05f service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb for instance with vm_state building and task_state spawning.
Oct 20 16:22:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-a198baba-2a34-4dab-8063-16b7647d791b req-fd6a2807-2897-497a-aaeb-83368571db1e service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a198baba-2a34-4dab-8063-16b7647d791b req-fd6a2807-2897-497a-aaeb-83368571db1e service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a198baba-2a34-4dab-8063-16b7647d791b req-fd6a2807-2897-497a-aaeb-83368571db1e service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a198baba-2a34-4dab-8063-16b7647d791b req-fd6a2807-2897-497a-aaeb-83368571db1e service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-a198baba-2a34-4dab-8063-16b7647d791b req-fd6a2807-2897-497a-aaeb-83368571db1e service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:50 user nova-compute[74131]: WARNING nova.compute.manager [req-a198baba-2a34-4dab-8063-16b7647d791b req-fd6a2807-2897-497a-aaeb-83368571db1e service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc for instance with vm_state building and task_state spawning.
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:22:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance spawned successfully.
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9c09455-a0a0-4120-ab2f-54b9777efc60 req-b2691995-5bf8-4852-8de0-6feb9df9a492 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9c09455-a0a0-4120-ab2f-54b9777efc60 req-b2691995-5bf8-4852-8de0-6feb9df9a492 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9c09455-a0a0-4120-ab2f-54b9777efc60 req-b2691995-5bf8-4852-8de0-6feb9df9a492 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9c09455-a0a0-4120-ab2f-54b9777efc60 req-b2691995-5bf8-4852-8de0-6feb9df9a492 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9c09455-a0a0-4120-ab2f-54b9777efc60 req-b2691995-5bf8-4852-8de0-6feb9df9a492 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:51 user nova-compute[74131]: WARNING nova.compute.manager [req-c9c09455-a0a0-4120-ab2f-54b9777efc60 req-b2691995-5bf8-4852-8de0-6feb9df9a492 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e for instance with vm_state building and task_state spawning.
Oct 20 16:22:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:51 user nova-compute[74131]: INFO nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Took 17.13 seconds to spawn the instance on the hypervisor.
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:22:51 user nova-compute[74131]: INFO nova.compute.manager [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Took 100.18 seconds to build instance.
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb33c5bf-bfcf-4afb-b187-df1e4ec906f4 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 100.344s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:51 user nova-compute[74131]: WARNING nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb for instance with vm_state building and task_state spawning.
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:51 user nova-compute[74131]: WARNING nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 for instance with vm_state building and task_state spawning.
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:51 user nova-compute[74131]: WARNING nova.compute.manager [req-58e9140f-727e-4957-a19f-6a6ba569e20b req-55129e06-0f46-41f8-8b97-5d6b01bd8018 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 for instance with vm_state building and task_state spawning.
Oct 20 16:22:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:52 user nova-compute[74131]: WARNING nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc for instance with vm_state building and task_state spawning.
Oct 20 16:22:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:52 user nova-compute[74131]: WARNING nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 for instance with vm_state building and task_state spawning.
Oct 20 16:22:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:52 user nova-compute[74131]: WARNING nova.compute.manager [req-da63c671-f434-4b57-bb45-4a81a8ce9a5b req-1b907153-f0c5-43c6-a50c-2203a583c46d service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 for instance with vm_state building and task_state spawning.
Oct 20 16:22:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-a9d9e618-9d97-4458-858f-e393a2fa4dc9 req-f8eee5ba-ba29-4d4d-ba2b-da0915f729aa service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9d9e618-9d97-4458-858f-e393a2fa4dc9 req-f8eee5ba-ba29-4d4d-ba2b-da0915f729aa service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9d9e618-9d97-4458-858f-e393a2fa4dc9 req-f8eee5ba-ba29-4d4d-ba2b-da0915f729aa service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9d9e618-9d97-4458-858f-e393a2fa4dc9 req-f8eee5ba-ba29-4d4d-ba2b-da0915f729aa service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-a9d9e618-9d97-4458-858f-e393a2fa4dc9 req-f8eee5ba-ba29-4d4d-ba2b-da0915f729aa service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:53 user nova-compute[74131]: WARNING nova.compute.manager [req-a9d9e618-9d97-4458-858f-e393a2fa4dc9 req-f8eee5ba-ba29-4d4d-ba2b-da0915f729aa service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e for instance with vm_state building and task_state spawning.
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:22:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance spawned successfully.
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:22:53 user nova-compute[74131]: INFO nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Took 19.28 seconds to spawn the instance on the hypervisor.
Oct 20 16:22:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:22:53 user nova-compute[74131]: INFO nova.compute.manager [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Took 101.68 seconds to build instance.
Oct 20 16:22:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-15acc7c3-f674-4903-bf52-b7a05e524afc tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "3308d7fc-97c0-4491-89da-b2c764637509" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 101.791s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:56 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 is timed out.
Oct 20 16:22:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully detached device vdb from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the live domain config.
Oct 20 16:22:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MweBtSxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:56 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[991cf588-624a-40e0-b35f-4dd1dff1aeae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:22:56 user nova-compute[74131]: No targets found.
Oct 20 16:22:56 user nova-compute[74131]: iSNS:
Oct 20 16:22:56 user nova-compute[74131]: No targets found.
Oct 20 16:22:56 user nova-compute[74131]: STATIC:
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:22:56 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:22:56 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:22:56 user nova-compute[74131]: FIRMWARE:
Oct 20 16:22:56 user nova-compute[74131]: No targets found.
Oct 20 16:22:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:22:56 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:22:56 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41dcb9a-26dc-49ab-b946-797a79df5dce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6bdebc-0e66-419e-8d22-1e11611416eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:56 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e0158820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c'): ({'sdc'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Removing single pathed devices sdc {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baca78e-9e19-4dd6-b3df-fe4ff2b0b52d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[47603f3d-ee99-474e-8965-a73a384151d1]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Flushing IO for device /dev/sdc {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7eea3-a9d0-4797-9750-cbdabd1c0d7e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473faaa-2319-49ae-8a41-530875f63c87]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4921cd46-0439-4c26-a96d-07db2e3b54fd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgDHCnEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:57 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d49587f-f946-496a-a2d4-8d59a2108831]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260]
Oct 20 16:22:57 user nova-compute[74131]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995a799a-54e5-4b04-9d0d-94e9f710830c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb7ea6e-1d0c-407f-bb0a-5ad1376baa5b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] <== disconnect_volume: return (446ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.103s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:57 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:57 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e6d46c-8a15-45cf-bca6-ce4302c016ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:57 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b23836d-ce5d-4530-934e-ce94e7aaecfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0] added
Oct 20 16:22:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62d2ead-8841-4c23-8e3e-51f193befc0a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "5b627751-886a-4ae3-8027-d48db36f8269" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "5b627751-886a-4ae3-8027-d48db36f8269" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "5b627751-886a-4ae3-8027-d48db36f8269-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbdbb4e-aafe-4a11-86c0-01b7a80e0eaf]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: INFO nova.compute.manager [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Terminating instance
Oct 20 16:22:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgDHCnEu {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgDHCnEu" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3085ea-881b-4c26-86d2-d3e36fbc756c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dgDHCnEu'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e144dea9-cbcf-43ab-b535-fdfba36b9b22]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.060s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb479ae-5671-44b4-8767-539d2447f231]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.194s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[50077e95-600a-4aef-96f5-09b15cd41a3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260]
Oct 20 16:22:57 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50e36c8-80e3-4f97-a971-df39879e270b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e1dc73-e3a6-47a2-b03d-8d843ec3feaa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:57 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.570s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-18d0b211-c3a2-4c60-bed8-355b52b1289f req-49707a27-61f0-45c5-98da-01916202b7ce service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received event network-vif-unplugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-18d0b211-c3a2-4c60-bed8-355b52b1289f req-49707a27-61f0-45c5-98da-01916202b7ce service nova] Acquiring lock "5b627751-886a-4ae3-8027-d48db36f8269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-18d0b211-c3a2-4c60-bed8-355b52b1289f req-49707a27-61f0-45c5-98da-01916202b7ce service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-18d0b211-c3a2-4c60-bed8-355b52b1289f req-49707a27-61f0-45c5-98da-01916202b7ce service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-18d0b211-c3a2-4c60-bed8-355b52b1289f req-49707a27-61f0-45c5-98da-01916202b7ce service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] No waiting events found dispatching network-vif-unplugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-18d0b211-c3a2-4c60-bed8-355b52b1289f req-49707a27-61f0-45c5-98da-01916202b7ce service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received event network-vif-unplugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c1667-680a-44e8-8f0e-75c6536d2422]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgDHCnEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbvIYEKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:57 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:58 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d2f0a264-c008-4a8d-a043-e3d391371e03 could not be found.
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:22:58 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Instance destroyed successfully.
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.objects.instance [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lazy-loading 'resources' on Instance uuid 5b627751-886a-4ae3-8027-d48db36f8269 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1745900382',display_name='tempest-VolumesActionsTest-instance-1745900382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1745900382',id=7,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:20:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='154d78ec7c55437f899034d0b89d57b7',ramdisk_id='',reservation_id='r-9tizpd0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1916779670',owner_user_name='tempest-VolumesActionsTest-1916779670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:20:27Z,user_data=None,user_id='38e781094ef6424f8af6b8453fb5a9af',uuid=5b627751-886a-4ae3-8027-d48db36f8269,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Converting VIF {"id": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "address": "fa:16:3e:00:19:74", "network": {"id": "764822b7-82ea-43d8-8877-fca289d4b147", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1498977009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154d78ec7c55437f899034d0b89d57b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc6a4e3f-0a", "ovs_interfaceid": "bc6a4e3f-0a82-46f1-9fa5-009b9948b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:19:74,bridge_name='br-int',has_traffic_filtering=True,id=bc6a4e3f-0a82-46f1-9fa5-009b9948b510,network=Network(764822b7-82ea-43d8-8877-fca289d4b147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc6a4e3f-0a') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_vif [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:19:74,bridge_name='br-int',has_traffic_filtering=True,id=bc6a4e3f-0a82-46f1-9fa5-009b9948b510,network=Network(764822b7-82ea-43d8-8877-fca289d4b147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc6a4e3f-0a') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc6a4e3f-0a, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcc97a92-d3d2-483f-a3ee-521baa481768) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:22:58 user nova-compute[74131]: INFO os_vif [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:19:74,bridge_name='br-int',has_traffic_filtering=True,id=bc6a4e3f-0a82-46f1-9fa5-009b9948b510,network=Network(764822b7-82ea-43d8-8877-fca289d4b147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc6a4e3f-0a')
Oct 20 16:22:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Deleting instance files /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269_del
Oct 20 16:22:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Deletion of /opt/stack/data/nova/instances/5b627751-886a-4ae3-8027-d48db36f8269_del complete
Oct 20 16:22:58 user nova-compute[74131]: INFO nova.compute.manager [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.664s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] <== connect_volume: return (1767ms) {'type': 'block', 'scsi_wwn': '26263333533333437', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263333533333437', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:58 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:22:58 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.objects.instance [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lazy-loading 'flavor' on Instance uuid eea7c78b-928f-4e65-956a-cb57026ef891 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.objects.instance [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'flavor' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f9c31-375b-47b7-99af-515174a42de9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:22:58 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bc2925-67f3-4995-91e9-aa3b5876278f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d] added
Oct 20 16:22:58 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:22:58 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:22:58 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:22:58 user nova-compute[74131]:   <target dev="sdc" bus="scsi"/>
Oct 20 16:22:58 user nova-compute[74131]:   <serial>3d74096c-47c0-477b-b3e7-52af8addd9e0</serial>
Oct 20 16:22:58 user nova-compute[74131]:   <address type="drive" controller="0" unit="2"/>
Oct 20 16:22:58 user nova-compute[74131]: </disk>
Oct 20 16:22:58 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bbcc10-f8e9-4aef-b338-03fbf5c184b2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02301c6-3e11-4e05-a7e7-317dece3842b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbvIYEKC {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1f212501-e203-49b4-b60e-a2388a0d54d3 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.012s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbvIYEKC" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a0ace-88b3-4fe6-bfe3-08245837a85c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbvIYEKC'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f7cb0-5a14-41d4-aa7e-80dcf3b1b78b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9942a46a-ccff-435d-a873-78b59cc84b27]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:22:59 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Took 0.68 seconds to deallocate network for instance.
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-a4195f09-ad37-4663-9617-a8d0c7f118d6 req-0803ef35-ece7-41fc-bae7-67782f727a52 service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received event network-vif-deleted-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[98520fdd-54de-4111-a777-75de2337709b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260]
Oct 20 16:22:59 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260] successful.
Oct 20 16:22:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[35391f64-9cb3-4c4c-aa25-1e75a43af9d7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e8a89-8d5b-4811-bc61-4d4614d167f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:22:59 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:22:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.503s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[db03d59e-6031-4526-b950-c2f96df40b3d]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbvIYEKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] No BDM found with device name sda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] No VIF found with MAC fa:16:3e:19:a3:09, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-620d9344-4d70-4e05-a1ea-fb41e8ac61cf tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.041s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-519319e2-cd54-440a-87e4-226a9963ad32 req-dad74d97-0879-421e-869f-0ba89b3c846b service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received event network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-519319e2-cd54-440a-87e4-226a9963ad32 req-dad74d97-0879-421e-869f-0ba89b3c846b service nova] Acquiring lock "5b627751-886a-4ae3-8027-d48db36f8269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-519319e2-cd54-440a-87e4-226a9963ad32 req-dad74d97-0879-421e-869f-0ba89b3c846b service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-519319e2-cd54-440a-87e4-226a9963ad32 req-dad74d97-0879-421e-869f-0ba89b3c846b service nova] Lock "5b627751-886a-4ae3-8027-d48db36f8269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-519319e2-cd54-440a-87e4-226a9963ad32 req-dad74d97-0879-421e-869f-0ba89b3c846b service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] No waiting events found dispatching network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:22:59 user nova-compute[74131]: WARNING nova.compute.manager [req-519319e2-cd54-440a-87e4-226a9963ad32 req-dad74d97-0879-421e-869f-0ba89b3c846b service nova] [instance: 5b627751-886a-4ae3-8027-d48db36f8269] Received unexpected event network-vif-plugged-bc6a4e3f-0a82-46f1-9fa5-009b9948b510 for instance with vm_state deleted and task_state None.
Oct 20 16:22:59 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Deleted allocations for instance 5b627751-886a-4ae3-8027-d48db36f8269
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "interface-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "interface-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'flavor' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converting VIF {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:22:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface> {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface> {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Attempting to detach device tap8bdb2f4e-29 from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] detach device xml: <interface type="ethernet">
Oct 20 16:23:00 user nova-compute[74131]:   <mac address="fa:16:3e:3b:00:0a"/>
Oct 20 16:23:00 user nova-compute[74131]:   <model type="virtio"/>
Oct 20 16:23:00 user nova-compute[74131]:   <mtu size="1442"/>
Oct 20 16:23:00 user nova-compute[74131]:   <target dev="tap8bdb2f4e-29"/>
Oct 20 16:23:00 user nova-compute[74131]: </interface>
Oct 20 16:23:00 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01ec85f6-4d9b-40f3-9649-6fb404f2c323 tempest-VolumesActionsTest-1916779670 tempest-VolumesActionsTest-1916779670-project-member] Lock "5b627751-886a-4ae3-8027-d48db36f8269" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface> {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface>not found in domain: <domain type='kvm' id='3'>
Oct 20 16:23:00 user nova-compute[74131]:   <name>instance-00000003</name>
Oct 20 16:23:00 user nova-compute[74131]:   <uuid>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</uuid>
Oct 20 16:23:00 user nova-compute[74131]:   <metadata>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:23:00 user nova-compute[74131]:   <nova:package version="0.0.0"/>
Oct 20 16:23:00 user nova-compute[74131]:   <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:23:00 user nova-compute[74131]:   <nova:creationTime>2023-10-20 16:21:38</nova:creationTime>
Oct 20 16:23:00 user nova-compute[74131]:   <nova:flavor name="m1.tiny">
Oct 20 16:23:00 user nova-compute[74131]:     <nova:memory>512</nova:memory>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:disk>1</nova:disk>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:swap>0</nova:swap>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:vcpus>1</nova:vcpus>
Oct 20 16:23:00 user nova-compute[74131]:   </nova:flavor>
Oct 20 16:23:00 user nova-compute[74131]:   <nova:owner>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:23:00 user nova-compute[74131]:   </nova:owner>
Oct 20 16:23:00 user nova-compute[74131]:   <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:23:00 user nova-compute[74131]:   <nova:ports>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:23:00 user nova-compute[74131]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:23:00 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:00 user nova-compute[74131]:     <nova:port uuid="8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce">
Oct 20 16:23:00 user nova-compute[74131]:       <nova:ip type="fixed" address="10.10.10.181" ipVersion="4"/>
Oct 20 16:23:00 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:00 user nova-compute[74131]:   </nova:ports>
Oct 20 16:23:00 user nova-compute[74131]: </nova:instance>
Oct 20 16:23:00 user nova-compute[74131]:   </metadata>
Oct 20 16:23:00 user nova-compute[74131]:   <memory unit='KiB'>524288</memory>
Oct 20 16:23:00 user nova-compute[74131]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 16:23:00 user nova-compute[74131]:   <vcpu placement='static'>1</vcpu>
Oct 20 16:23:00 user nova-compute[74131]:   <resource>
Oct 20 16:23:00 user nova-compute[74131]:     <partition>/machine</partition>
Oct 20 16:23:00 user nova-compute[74131]:   </resource>
Oct 20 16:23:00 user nova-compute[74131]:   <sysinfo type='smbios'>
Oct 20 16:23:00 user nova-compute[74131]:     <system>
Oct 20 16:23:00 user nova-compute[74131]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 16:23:00 user nova-compute[74131]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 16:23:00 user nova-compute[74131]:       <entry name='version'>0.0.0</entry>
Oct 20 16:23:00 user nova-compute[74131]:       <entry name='serial'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:00 user nova-compute[74131]:       <entry name='uuid'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:00 user nova-compute[74131]:       <entry name='family'>Virtual Machine</entry>
Oct 20 16:23:00 user nova-compute[74131]:     </system>
Oct 20 16:23:00 user nova-compute[74131]:   </sysinfo>
Oct 20 16:23:00 user nova-compute[74131]:   <os>
Oct 20 16:23:00 user nova-compute[74131]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 16:23:00 user nova-compute[74131]:     <boot dev='hd'/>
Oct 20 16:23:00 user nova-compute[74131]:     <smbios mode='sysinfo'/>
Oct 20 16:23:00 user nova-compute[74131]:   </os>
Oct 20 16:23:00 user nova-compute[74131]:   <features>
Oct 20 16:23:00 user nova-compute[74131]:     <acpi/>
Oct 20 16:23:00 user nova-compute[74131]:     <apic/>
Oct 20 16:23:00 user nova-compute[74131]:     <vmcoreinfo state='on'/>
Oct 20 16:23:00 user nova-compute[74131]:   </features>
Oct 20 16:23:00 user nova-compute[74131]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 16:23:00 user nova-compute[74131]:     <model fallback='forbid'>Nehalem</model>
Oct 20 16:23:00 user nova-compute[74131]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 16:23:00 user nova-compute[74131]:     <feature policy='require' name='vme'/>
Oct 20 16:23:00 user nova-compute[74131]:     <feature policy='require' name='x2apic'/>
Oct 20 16:23:00 user nova-compute[74131]:     <feature policy='require' name='hypervisor'/>
Oct 20 16:23:00 user nova-compute[74131]:   </cpu>
Oct 20 16:23:00 user nova-compute[74131]:   <clock offset='utc'>
Oct 20 16:23:00 user nova-compute[74131]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 16:23:00 user nova-compute[74131]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 16:23:00 user nova-compute[74131]:     <timer name='hpet' present='no'/>
Oct 20 16:23:00 user nova-compute[74131]:   </clock>
Oct 20 16:23:00 user nova-compute[74131]:   <on_poweroff>destroy</on_poweroff>
Oct 20 16:23:00 user nova-compute[74131]:   <on_reboot>restart</on_reboot>
Oct 20 16:23:00 user nova-compute[74131]:   <on_crash>destroy</on_crash>
Oct 20 16:23:00 user nova-compute[74131]:   <devices>
Oct 20 16:23:00 user nova-compute[74131]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 16:23:00 user nova-compute[74131]:     <disk type='file' device='disk'>
Oct 20 16:23:00 user nova-compute[74131]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 16:23:00 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk' index='2'/>
Oct 20 16:23:00 user nova-compute[74131]:       <backingStore type='file' index='3'>
Oct 20 16:23:00 user nova-compute[74131]:         <format type='raw'/>
Oct 20 16:23:00 user nova-compute[74131]:         <source file='/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e'/>
Oct 20 16:23:00 user nova-compute[74131]:         <backingStore/>
Oct 20 16:23:00 user nova-compute[74131]:       </backingStore>
Oct 20 16:23:00 user nova-compute[74131]:       <target dev='vda' bus='virtio'/>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='virtio-disk0'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </disk>
Oct 20 16:23:00 user nova-compute[74131]:     <disk type='file' device='cdrom'>
Oct 20 16:23:00 user nova-compute[74131]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 16:23:00 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config' index='1'/>
Oct 20 16:23:00 user nova-compute[74131]:       <backingStore/>
Oct 20 16:23:00 user nova-compute[74131]:       <target dev='hda' bus='ide'/>
Oct 20 16:23:00 user nova-compute[74131]:       <readonly/>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='ide0-0-0'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </disk>
Oct 20 16:23:00 user nova-compute[74131]:     <controller type='usb' index='0' model='none'>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='usb'/>
Oct 20 16:23:00 user nova-compute[74131]:     </controller>
Oct 20 16:23:00 user nova-compute[74131]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='pci.0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </controller>
Oct 20 16:23:00 user nova-compute[74131]:     <controller type='ide' index='0'>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='ide'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 16:23:00 user nova-compute[74131]:     </controller>
Oct 20 16:23:00 user nova-compute[74131]:     <interface type='ethernet'>
Oct 20 16:23:00 user nova-compute[74131]:       <mac address='fa:16:3e:7f:40:bb'/>
Oct 20 16:23:00 user nova-compute[74131]:       <target dev='tap846a2357-b3'/>
Oct 20 16:23:00 user nova-compute[74131]:       <model type='virtio'/>
Oct 20 16:23:00 user nova-compute[74131]:       <mtu size='1442'/>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='net0'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </interface>
Oct 20 16:23:00 user nova-compute[74131]:     <interface type='ethernet'>
Oct 20 16:23:00 user nova-compute[74131]:       <mac address='fa:16:3e:3b:00:0a'/>
Oct 20 16:23:00 user nova-compute[74131]:       <target dev='tap8bdb2f4e-29'/>
Oct 20 16:23:00 user nova-compute[74131]:       <model type='virtio'/>
Oct 20 16:23:00 user nova-compute[74131]:       <mtu size='1442'/>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='net1'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </interface>
Oct 20 16:23:00 user nova-compute[74131]:     <serial type='pty'>
Oct 20 16:23:00 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:00 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:00 user nova-compute[74131]:       <target type='isa-serial' port='0'>
Oct 20 16:23:00 user nova-compute[74131]:         <model name='isa-serial'/>
Oct 20 16:23:00 user nova-compute[74131]:       </target>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </serial>
Oct 20 16:23:00 user nova-compute[74131]:     <console type='pty' tty='/dev/pts/2'>
Oct 20 16:23:00 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:00 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:00 user nova-compute[74131]:       <target type='serial' port='0'/>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </console>
Oct 20 16:23:00 user nova-compute[74131]:     <input type='mouse' bus='ps2'>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='input0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </input>
Oct 20 16:23:00 user nova-compute[74131]:     <input type='keyboard' bus='ps2'>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='input1'/>
Oct 20 16:23:00 user nova-compute[74131]:     </input>
Oct 20 16:23:00 user nova-compute[74131]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Oct 20 16:23:00 user nova-compute[74131]:       <listen type='address' address='0.0.0.0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </graphics>
Oct 20 16:23:00 user nova-compute[74131]:     <audio id='1' type='none'/>
Oct 20 16:23:00 user nova-compute[74131]:     <video>
Oct 20 16:23:00 user nova-compute[74131]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='video0'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </video>
Oct 20 16:23:00 user nova-compute[74131]:     <memballoon model='virtio'>
Oct 20 16:23:00 user nova-compute[74131]:       <stats period='10'/>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='balloon0'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </memballoon>
Oct 20 16:23:00 user nova-compute[74131]:     <rng model='virtio'>
Oct 20 16:23:00 user nova-compute[74131]:       <backend model='random'>/dev/urandom</backend>
Oct 20 16:23:00 user nova-compute[74131]:       <alias name='rng0'/>
Oct 20 16:23:00 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 16:23:00 user nova-compute[74131]:     </rng>
Oct 20 16:23:00 user nova-compute[74131]:   </devices>
Oct 20 16:23:00 user nova-compute[74131]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 16:23:00 user nova-compute[74131]:     <label>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</label>
Oct 20 16:23:00 user nova-compute[74131]:     <imagelabel>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</imagelabel>
Oct 20 16:23:00 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:00 user nova-compute[74131]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 16:23:00 user nova-compute[74131]:     <label>+64055:+108</label>
Oct 20 16:23:00 user nova-compute[74131]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 16:23:00 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:00 user nova-compute[74131]: </domain>
Oct 20 16:23:00 user nova-compute[74131]:  {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 16:23:00 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully detached device tap8bdb2f4e-29 from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the persistent domain config.
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] (1/8): Attempting to detach device tap8bdb2f4e-29 with device alias net1 from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] detach device xml: <interface type="ethernet">
Oct 20 16:23:00 user nova-compute[74131]:   <mac address="fa:16:3e:3b:00:0a"/>
Oct 20 16:23:00 user nova-compute[74131]:   <model type="virtio"/>
Oct 20 16:23:00 user nova-compute[74131]:   <mtu size="1442"/>
Oct 20 16:23:00 user nova-compute[74131]:   <target dev="tap8bdb2f4e-29"/>
Oct 20 16:23:00 user nova-compute[74131]: </interface>
Oct 20 16:23:00 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.553s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] <== connect_volume: return (2552ms) {'type': 'block', 'scsi_wwn': '26535393032653730', 'path': '/dev/sdk'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535393032653730', 'path': '/dev/sdk'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.296s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lazy-loading 'flavor' on Instance uuid fe867561-330e-4ccd-a012-46d4420bcbaf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cf0fb3-8eef-41f6-beee-fd2a98373716]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:23:00 user nova-compute[74131]: No targets found.
Oct 20 16:23:00 user nova-compute[74131]: iSNS:
Oct 20 16:23:00 user nova-compute[74131]: No targets found.
Oct 20 16:23:00 user nova-compute[74131]: STATIC:
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0
Oct 20 16:23:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:00 user nova-compute[74131]: FIRMWARE:
Oct 20 16:23:00 user nova-compute[74131]: No targets found.
Oct 20 16:23:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:23:00 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:23:00 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16622a0-51a9-45b1-bb86-d7b82ac78fd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc66c6f5-608e-4811-8df7-654cb9943e22]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 16:23:00 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:23:00 user nova-compute[74131]:   <source dev="/dev/sdk"/>
Oct 20 16:23:00 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:23:00 user nova-compute[74131]:   <serial>e3fec81f-4e5c-4565-bb16-166252e0812d</serial>
Oct 20 16:23:00 user nova-compute[74131]: </disk>
Oct 20 16:23:00 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:00 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c87aed40>, {}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Disconnecting from: [] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.140s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] <== disconnect_volume: return (2435ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Start waiting for the detach event from libvirt for device tap8bdb2f4e-29 with device alias net1 for instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:23:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] No VIF found with MAC fa:16:3e:87:d0:fc, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7308dc30-c720-4711-bccd-44276c09474b tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.612s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:01 user nova-compute[74131]: INFO nova.compute.manager [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Detaching volume 3d74096c-47c0-477b-b3e7-52af8addd9e0
Oct 20 16:23:01 user nova-compute[74131]: INFO nova.virt.block_device [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Attempting to driver detach volume 3d74096c-47c0-477b-b3e7-52af8addd9e0 from mountpoint /dev/sdc
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Attempting to detach device sdc from instance eea7c78b-928f-4e65-956a-cb57026ef891 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:23:01 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:23:01 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:23:01 user nova-compute[74131]:   <target dev="sdc" bus="scsi"/>
Oct 20 16:23:01 user nova-compute[74131]:   <serial>3d74096c-47c0-477b-b3e7-52af8addd9e0</serial>
Oct 20 16:23:01 user nova-compute[74131]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 16:23:01 user nova-compute[74131]: </disk>
Oct 20 16:23:01 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:23:01 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Successfully detached device sdc from instance eea7c78b-928f-4e65-956a-cb57026ef891 from the persistent domain config.
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance eea7c78b-928f-4e65-956a-cb57026ef891 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:23:01 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:23:01 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:23:01 user nova-compute[74131]:   <target dev="sdc" bus="scsi"/>
Oct 20 16:23:01 user nova-compute[74131]:   <serial>3d74096c-47c0-477b-b3e7-52af8addd9e0</serial>
Oct 20 16:23:01 user nova-compute[74131]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 16:23:01 user nova-compute[74131]: </disk>
Oct 20 16:23:01 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Preparing to wait for external event volume-reimaged-3c25cebe-bc8c-40af-81e6-4d28c5e7f158 {{(pid=74131) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-unplugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-unplugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:01 user nova-compute[74131]: WARNING nova.compute.manager [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received unexpected event network-vif-unplugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce for instance with vm_state active and task_state None.
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:01 user nova-compute[74131]: WARNING nova.compute.manager [req-a3aa212a-6a57-4706-8eb0-a7cb69b74a16 req-a3a7d625-7904-40b7-b451-e25732debaa5 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received unexpected event network-vif-plugged-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce for instance with vm_state active and task_state None.
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance eea7c78b-928f-4e65-956a-cb57026ef891 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] volume_snapshot_create: create_info: {'snapshot_id': 'b2478309-0bd2-4e0a-8863-f21b13b76043', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74131) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] snap xml: <domainsnapshot>
Oct 20 16:23:01 user nova-compute[74131]:   <disks>
Oct 20 16:23:01 user nova-compute[74131]:     <disk name="/dev/sdk" snapshot="external" type="file">
Oct 20 16:23:01 user nova-compute[74131]:       <source file="/dev/new_file"/>
Oct 20 16:23:01 user nova-compute[74131]:     </disk>
Oct 20 16:23:01 user nova-compute[74131]:     <disk name="vda" snapshot="no"/>
Oct 20 16:23:01 user nova-compute[74131]:   </disks>
Oct 20 16:23:01 user nova-compute[74131]: </domainsnapshot>
Oct 20 16:23:01 user nova-compute[74131]:  {{(pid=74131) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 16:23:01 user nova-compute[74131]: DEBUG nova.objects.instance [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] Lazy-loading 'system_metadata' on Instance uuid fe867561-330e-4ccd-a012-46d4420bcbaf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 16:23:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8b591753-42c8-4bf7-8df9-044eb5e92b42 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] volume_snapshot_delete: delete_info: {'volume_id': 'e3fec81f-4e5c-4565-bb16-166252e0812d'} {{(pid=74131) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [None req-8b591753-42c8-4bf7-8df9-044eb5e92b42 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     if delete_info['type'] != 'qcow2':
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] KeyError: 'type'
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     rv = execute(f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     six.reraise(c, e, tb)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     raise value
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     rv = meth(*args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     self._volume_snapshot_create(context, instance, guest,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     rv = execute(f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     six.reraise(c, e, tb)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     raise value
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     rv = meth(*args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [None req-8b591753-42c8-4bf7-8df9-044eb5e92b42 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-72ec850b-c733-43b9-be94-2ea62392cacb)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server [None req-8b591753-42c8-4bf7-8df9-044eb5e92b42 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] Exception during message handling: KeyError: 'type'
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b2478309-0bd2-4e0a-8863-f21b13b76043 could not be found.
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b2478309-0bd2-4e0a-8863-f21b13b76043 could not be found. (HTTP 404) (Request-ID: req-22801714-bad1-401f-ba45-429a4e920bfa)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b2478309-0bd2-4e0a-8863-f21b13b76043 could not be found.
Oct 20 16:23:02 user nova-compute[74131]: ERROR nova.virt.libvirt.driver 
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server [None req-1c3c533d-d51d-4089-92fd-85839aed2609 tempest-VolumesAssistedSnapshotsTest-1961299251 tempest-VolumesAssistedSnapshotsTest-1961299251-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 16:23:02 user nova-compute[74131]: ERROR oslo_messaging.rpc.server 
Oct 20 16:23:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgRQpvdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6f5e776-329d-4e3c-a18c-ca4a01789def', 'attached_at': '', 'detached_at': '', 'volume_id': '2839858f-1ded-44ed-bf91-69da4885562c', 'serial': '2839858f-1ded-44ed-bf91-69da4885562c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a6f5e776-329d-4e3c-a18c-ca4a01789def', 'attached_at': '', 'detached_at': '', 'volume_id': '119f7808-e6ad-43ab-abca-8c214cc87240', 'serial'} {{(pid=74131) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgRQpvdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:02 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:02 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:02 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad8c07a-9991-44dd-9848-d4c680d8dc9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:23:02 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d4611f-d1fd-4965-8444-74344aa0c3f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c] added
Oct 20 16:23:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b9ced-c56b-4234-b63d-ba0df1ca67fe]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: INFO nova.compute.manager [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Detaching volume e3fec81f-4e5c-4565-bb16-166252e0812d
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee3c3e2-2d62-405f-8696-fb9f5aa28afe]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgRQpvdX {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgRQpvdX" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a35cdcb-29c9-42eb-88cd-36a2eea18692]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgRQpvdX'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997f66e-7337-4b2b-b986-e88fe5660afa]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: INFO nova.virt.block_device [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Attempting to driver detach volume e3fec81f-4e5c-4565-bb16-166252e0812d from mountpoint /dev/vdb
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e29506-ab39-471f-a066-c708d17299e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Attempting to detach device vdb from instance fe867561-330e-4ccd-a012-46d4420bcbaf from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 16:23:02 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:23:02 user nova-compute[74131]:   <source dev="/dev/sdk"/>
Oct 20 16:23:02 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:23:02 user nova-compute[74131]:   <serial>e3fec81f-4e5c-4565-bb16-166252e0812d</serial>
Oct 20 16:23:02 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:23:02 user nova-compute[74131]: </disk>
Oct 20 16:23:02 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Successfully detached device vdb from instance fe867561-330e-4ccd-a012-46d4420bcbaf from the persistent domain config.
Oct 20 16:23:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe867561-330e-4ccd-a012-46d4420bcbaf from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 16:23:02 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:23:02 user nova-compute[74131]:   <source dev="/dev/sdk"/>
Oct 20 16:23:02 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:23:02 user nova-compute[74131]:   <serial>e3fec81f-4e5c-4565-bb16-166252e0812d</serial>
Oct 20 16:23:02 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:23:02 user nova-compute[74131]: </disk>
Oct 20 16:23:02 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c18ee-4286-4081-b932-c525acd83026]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260]
Oct 20 16:23:02 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260] successful.
Oct 20 16:23:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e7b02f-7461-4fe2-a595-19c7d268ca9c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3c0164-a893-4f9e-95b4-fa0a258b0334]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:02 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] HCTL ('43', '-', '-', 0) found on session 15 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d934d2-ca46-41ed-96db-8da611502c02]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:23:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgRQpvdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:23:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe867561-330e-4ccd-a012-46d4420bcbaf {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:23:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.514s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] <== connect_volume: return (1516ms) {'type': 'block', 'scsi_wwn': '23933643865633461', 'path': '/dev/sdl'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643865633461', 'path': '/dev/sdl'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:23:03 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lazy-loading 'flavor' on Instance uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 241172480 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 495976448 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 735051776 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 855638016 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 1013972992 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[169d4606-fbb4-4c54-907a-779a76bfdcb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:23:09 user nova-compute[74131]: No targets found.
Oct 20 16:23:09 user nova-compute[74131]: iSNS:
Oct 20 16:23:09 user nova-compute[74131]: No targets found.
Oct 20 16:23:09 user nova-compute[74131]: STATIC:
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0
Oct 20 16:23:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:09 user nova-compute[74131]: FIRMWARE:
Oct 20 16:23:09 user nova-compute[74131]: No targets found.
Oct 20 16:23:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:23:09 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:23:09 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfadeea2-8b52-4d2f-9adc-4dea79a1ac43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d501eb1b-39e5-4f4a-9314-35d07034e25c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:09 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c81f0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240'): ({'sde'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Removing single pathed devices sde {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e948e8-b45a-475a-901d-70e2d2044c69]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d031cb05-f0e8-43db-a8fd-c0e6d7b7628a]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Flushing IO for device /dev/sde {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91a8ec-7899-4a52-a145-0ffd346b188c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81272a8-afe4-482c-b992-ed61fe852b51]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0392f40f-e0c4-4eda-b091-08a00c873c4b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d8223b-8083-47c6-b049-24774427b5ae]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]
Oct 20 16:23:09 user nova-compute[74131]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.
Oct 20 16:23:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc137de-df3b-4e36-afb4-4844c99d7f7d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] <== disconnect_volume: return (472ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgRQpvdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': 'a6f5e776-329d-4e3c-a18c-ca4a01789def', 'attached_at': '', 'detached_at': '', 'volume_id': '2839858f-1ded-44ed-bf91-69da4885562c', 'serial'} {{(pid=74131) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] swap_volume: removing Cinder connection for volume 119f7808-e6ad-43ab-abca-8c214cc87240 {{(pid=74131) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 16:23:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-changed-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Refreshing instance network info cache due to event network-changed-c08fc7c0-8c6d-4d94-8e25-7dabdd052274. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] Acquiring lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] Acquired lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG nova.network.neutron [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Refreshing network info cache for port c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG nova.network.neutron [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updated VIF entry in instance network info cache for port c08fc7c0-8c6d-4d94-8e25-7dabdd052274. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG nova.network.neutron [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updating instance_info_cache with network_info: [{"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2c4a615a-25ad-41be-b3b3-c1c32feb60ef req-91ed8a7f-29d5-40c8-b090-888f530fd707 service nova] Releasing lock "refresh_cache-97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'flavor' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:11 user nova-compute[74131]: INFO nova.compute.manager [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Attaching volume dcd49c92-69bf-4992-a70f-469c293bc533 to /dev/vdb
Oct 20 16:23:11 user nova-compute[74131]: DEBUG os_brick.utils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6949279f-e036-4590-b0cb-22669f1bdc05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bd9d7b-221c-4f2c-b817-bbb69a2df0b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[01276800-a67a-468f-98e8-f133cafd11ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03c86ec-8560-46a8-88ff-783816ecb7ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:11 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf4df2-13ce-4ed6-a595-8f6db769dc7d]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG os_brick.utils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updating existing volume attachment record: 783b89cf-db13-41ed-ba09-e46efec68541 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:23:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:23:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:23:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:23:12 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updating instance_info_cache with network_info: [{"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-eea7c78b-928f-4e65-956a-cb57026ef891" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:23:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] swap_volume: Updating volume 119f7808-e6ad-43ab-abca-8c214cc87240 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "IgRQpvdX", "auth_password": "q7eVwrWZoTBa9h", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "2839858f-1ded-44ed-bf91-69da4885562c"}, "status": "reserved", "instance": "a6f5e776-329d-4e3c-a18c-ca4a01789def", "attached_at": "", "detached_at": "", "volume_id": "2839858f-1ded-44ed-bf91-69da4885562c", "serial": "2839858f-1ded-44ed-bf91-69da4885562c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2839858f-1ded-44ed-bf91-69da4885562c', 'no_device': None, 'attachment_id': '38302efb-0a3b-4817-9bf1-e1c02d2397ba'} {{(pid=74131) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 16:23:17 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:23:17 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:23:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=25.536296844482422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:23:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83c8c4ea-4612-45db-85b3-394436b60ede tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 41.223s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3e22a492-a812-415d-92c1-3cc51b842cc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance eea7c78b-928f-4e65-956a-cb57026ef891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6f5e776-329d-4e3c-a18c-ca4a01789def actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance fe867561-330e-4ccd-a012-46d4420bcbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d2f0a264-c008-4a8d-a043-e3d391371e03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3308d7fc-97c0-4491-89da-b2c764637509 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:23:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG os_brick.utils [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa859575-accb-4161-983c-904c5c61a7e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd8f3e-7086-49b5-a76a-b557b0e84a99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f904d1-654a-4be3-8c56-59e0035610db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab36392-2dc9-473e-83e4-93433dcc8d3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:19 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:23:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf06a9e5-c956-4b79-8594-9265f1f395c2]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:23:19 user nova-compute[74131]: DEBUG os_brick.utils [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:19 user nova-compute[74131]: INFO nova.compute.manager [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Swapping volume 2839858f-1ded-44ed-bf91-69da4885562c for 119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:23:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Waiting for libvirt event about the detach of device tap8bdb2f4e-29 with device alias net1 from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 is timed out.
Oct 20 16:23:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface> {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface>not found in domain: <domain type='kvm' id='3'>
Oct 20 16:23:20 user nova-compute[74131]:   <name>instance-00000003</name>
Oct 20 16:23:20 user nova-compute[74131]:   <uuid>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</uuid>
Oct 20 16:23:20 user nova-compute[74131]:   <metadata>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:23:20 user nova-compute[74131]:   <nova:package version="0.0.0"/>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:creationTime>2023-10-20 16:21:38</nova:creationTime>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:flavor name="m1.tiny">
Oct 20 16:23:20 user nova-compute[74131]:     <nova:memory>512</nova:memory>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:disk>1</nova:disk>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:swap>0</nova:swap>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:vcpus>1</nova:vcpus>
Oct 20 16:23:20 user nova-compute[74131]:   </nova:flavor>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:owner>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:23:20 user nova-compute[74131]:   </nova:owner>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:ports>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:23:20 user nova-compute[74131]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:23:20 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:port uuid="8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce">
Oct 20 16:23:20 user nova-compute[74131]:       <nova:ip type="fixed" address="10.10.10.181" ipVersion="4"/>
Oct 20 16:23:20 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:20 user nova-compute[74131]:   </nova:ports>
Oct 20 16:23:20 user nova-compute[74131]: </nova:instance>
Oct 20 16:23:20 user nova-compute[74131]:   </metadata>
Oct 20 16:23:20 user nova-compute[74131]:   <memory unit='KiB'>524288</memory>
Oct 20 16:23:20 user nova-compute[74131]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 16:23:20 user nova-compute[74131]:   <vcpu placement='static'>1</vcpu>
Oct 20 16:23:20 user nova-compute[74131]:   <resource>
Oct 20 16:23:20 user nova-compute[74131]:     <partition>/machine</partition>
Oct 20 16:23:20 user nova-compute[74131]:   </resource>
Oct 20 16:23:20 user nova-compute[74131]:   <sysinfo type='smbios'>
Oct 20 16:23:20 user nova-compute[74131]:     <system>
Oct 20 16:23:20 user nova-compute[74131]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 16:23:20 user nova-compute[74131]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 16:23:20 user nova-compute[74131]:       <entry name='version'>0.0.0</entry>
Oct 20 16:23:20 user nova-compute[74131]:       <entry name='serial'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:20 user nova-compute[74131]:       <entry name='uuid'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:20 user nova-compute[74131]:       <entry name='family'>Virtual Machine</entry>
Oct 20 16:23:20 user nova-compute[74131]:     </system>
Oct 20 16:23:20 user nova-compute[74131]:   </sysinfo>
Oct 20 16:23:20 user nova-compute[74131]:   <os>
Oct 20 16:23:20 user nova-compute[74131]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 16:23:20 user nova-compute[74131]:     <boot dev='hd'/>
Oct 20 16:23:20 user nova-compute[74131]:     <smbios mode='sysinfo'/>
Oct 20 16:23:20 user nova-compute[74131]:   </os>
Oct 20 16:23:20 user nova-compute[74131]:   <features>
Oct 20 16:23:20 user nova-compute[74131]:     <acpi/>
Oct 20 16:23:20 user nova-compute[74131]:     <apic/>
Oct 20 16:23:20 user nova-compute[74131]:     <vmcoreinfo state='on'/>
Oct 20 16:23:20 user nova-compute[74131]:   </features>
Oct 20 16:23:20 user nova-compute[74131]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 16:23:20 user nova-compute[74131]:     <model fallback='forbid'>Nehalem</model>
Oct 20 16:23:20 user nova-compute[74131]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 16:23:20 user nova-compute[74131]:     <feature policy='require' name='vme'/>
Oct 20 16:23:20 user nova-compute[74131]:     <feature policy='require' name='x2apic'/>
Oct 20 16:23:20 user nova-compute[74131]:     <feature policy='require' name='hypervisor'/>
Oct 20 16:23:20 user nova-compute[74131]:   </cpu>
Oct 20 16:23:20 user nova-compute[74131]:   <clock offset='utc'>
Oct 20 16:23:20 user nova-compute[74131]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 16:23:20 user nova-compute[74131]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 16:23:20 user nova-compute[74131]:     <timer name='hpet' present='no'/>
Oct 20 16:23:20 user nova-compute[74131]:   </clock>
Oct 20 16:23:20 user nova-compute[74131]:   <on_poweroff>destroy</on_poweroff>
Oct 20 16:23:20 user nova-compute[74131]:   <on_reboot>restart</on_reboot>
Oct 20 16:23:20 user nova-compute[74131]:   <on_crash>destroy</on_crash>
Oct 20 16:23:20 user nova-compute[74131]:   <devices>
Oct 20 16:23:20 user nova-compute[74131]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 16:23:20 user nova-compute[74131]:     <disk type='file' device='disk'>
Oct 20 16:23:20 user nova-compute[74131]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 16:23:20 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk' index='2'/>
Oct 20 16:23:20 user nova-compute[74131]:       <backingStore type='file' index='3'>
Oct 20 16:23:20 user nova-compute[74131]:         <format type='raw'/>
Oct 20 16:23:20 user nova-compute[74131]:         <source file='/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e'/>
Oct 20 16:23:20 user nova-compute[74131]:         <backingStore/>
Oct 20 16:23:20 user nova-compute[74131]:       </backingStore>
Oct 20 16:23:20 user nova-compute[74131]:       <target dev='vda' bus='virtio'/>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='virtio-disk0'/>
Oct 20 16:23:20 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </disk>
Oct 20 16:23:20 user nova-compute[74131]:     <disk type='file' device='cdrom'>
Oct 20 16:23:20 user nova-compute[74131]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 16:23:20 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config' index='1'/>
Oct 20 16:23:20 user nova-compute[74131]:       <backingStore/>
Oct 20 16:23:20 user nova-compute[74131]:       <target dev='hda' bus='ide'/>
Oct 20 16:23:20 user nova-compute[74131]:       <readonly/>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='ide0-0-0'/>
Oct 20 16:23:20 user nova-compute[74131]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </disk>
Oct 20 16:23:20 user nova-compute[74131]:     <controller type='usb' index='0' model='none'>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='usb'/>
Oct 20 16:23:20 user nova-compute[74131]:     </controller>
Oct 20 16:23:20 user nova-compute[74131]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='pci.0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </controller>
Oct 20 16:23:20 user nova-compute[74131]:     <controller type='ide' index='0'>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='ide'/>
Oct 20 16:23:20 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 16:23:20 user nova-compute[74131]:     </controller>
Oct 20 16:23:20 user nova-compute[74131]:     <interface type='ethernet'>
Oct 20 16:23:20 user nova-compute[74131]:       <mac address='fa:16:3e:7f:40:bb'/>
Oct 20 16:23:20 user nova-compute[74131]:       <target dev='tap846a2357-b3'/>
Oct 20 16:23:20 user nova-compute[74131]:       <model type='virtio'/>
Oct 20 16:23:20 user nova-compute[74131]:       <mtu size='1442'/>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='net0'/>
Oct 20 16:23:20 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </interface>
Oct 20 16:23:20 user nova-compute[74131]:     <serial type='pty'>
Oct 20 16:23:20 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:20 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:20 user nova-compute[74131]:       <target type='isa-serial' port='0'>
Oct 20 16:23:20 user nova-compute[74131]:         <model name='isa-serial'/>
Oct 20 16:23:20 user nova-compute[74131]:       </target>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </serial>
Oct 20 16:23:20 user nova-compute[74131]:     <console type='pty' tty='/dev/pts/2'>
Oct 20 16:23:20 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:20 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:20 user nova-compute[74131]:       <target type='serial' port='0'/>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </console>
Oct 20 16:23:20 user nova-compute[74131]:     <input type='mouse' bus='ps2'>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='input0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </input>
Oct 20 16:23:20 user nova-compute[74131]:     <input type='keyboard' bus='ps2'>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='input1'/>
Oct 20 16:23:20 user nova-compute[74131]:     </input>
Oct 20 16:23:20 user nova-compute[74131]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Oct 20 16:23:20 user nova-compute[74131]:       <listen type='address' address='0.0.0.0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </graphics>
Oct 20 16:23:20 user nova-compute[74131]:     <audio id='1' type='none'/>
Oct 20 16:23:20 user nova-compute[74131]:     <video>
Oct 20 16:23:20 user nova-compute[74131]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='video0'/>
Oct 20 16:23:20 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </video>
Oct 20 16:23:20 user nova-compute[74131]:     <memballoon model='virtio'>
Oct 20 16:23:20 user nova-compute[74131]:       <stats period='10'/>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='balloon0'/>
Oct 20 16:23:20 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </memballoon>
Oct 20 16:23:20 user nova-compute[74131]:     <rng model='virtio'>
Oct 20 16:23:20 user nova-compute[74131]:       <backend model='random'>/dev/urandom</backend>
Oct 20 16:23:20 user nova-compute[74131]:       <alias name='rng0'/>
Oct 20 16:23:20 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 16:23:20 user nova-compute[74131]:     </rng>
Oct 20 16:23:20 user nova-compute[74131]:   </devices>
Oct 20 16:23:20 user nova-compute[74131]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 16:23:20 user nova-compute[74131]:     <label>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</label>
Oct 20 16:23:20 user nova-compute[74131]:     <imagelabel>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</imagelabel>
Oct 20 16:23:20 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:20 user nova-compute[74131]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 16:23:20 user nova-compute[74131]:     <label>+64055:+108</label>
Oct 20 16:23:20 user nova-compute[74131]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 16:23:20 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:20 user nova-compute[74131]: </domain>
Oct 20 16:23:20 user nova-compute[74131]:  {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 16:23:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully detached device tap8bdb2f4e-29 from instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 from the live domain config.
Oct 20 16:23:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converting VIF {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG os_vif [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bdb2f4e-29, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38854b7c-3e61-40a2-9e22-be652175c498) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:20 user nova-compute[74131]: INFO os_vif [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29')
Oct 20 16:23:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:23:20 user nova-compute[74131]:   <nova:package version="0.0.0"/>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:creationTime>2023-10-20 16:23:20</nova:creationTime>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:flavor name="m1.tiny">
Oct 20 16:23:20 user nova-compute[74131]:     <nova:memory>512</nova:memory>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:disk>1</nova:disk>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:swap>0</nova:swap>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:vcpus>1</nova:vcpus>
Oct 20 16:23:20 user nova-compute[74131]:   </nova:flavor>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:owner>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:23:20 user nova-compute[74131]:   </nova:owner>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:23:20 user nova-compute[74131]:   <nova:ports>
Oct 20 16:23:20 user nova-compute[74131]:     <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:23:20 user nova-compute[74131]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:23:20 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:20 user nova-compute[74131]:   </nova:ports>
Oct 20 16:23:20 user nova-compute[74131]: </nova:instance>
Oct 20 16:23:20 user nova-compute[74131]:  {{(pid=74131) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquired lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-deleted-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:21 user nova-compute[74131]: INFO nova.compute.manager [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Neutron deleted interface 8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce; detaching it from the instance and deleting it from the info cache
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.objects.instance [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Lazy-loading 'system_metadata' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.objects.instance [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Lazy-loading 'flavor' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.objects.base [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Object Instance<ee67f6fa-6b81-46b5-a3cc-ef756c0ad477> lazy-loaded attributes: system_metadata,flavor {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.network.os_vif_util [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Converting VIF {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.network.os_vif_util [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface> {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface>not found in domain: <domain type='kvm' id='3'>
Oct 20 16:23:21 user nova-compute[74131]:   <name>instance-00000003</name>
Oct 20 16:23:21 user nova-compute[74131]:   <uuid>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</uuid>
Oct 20 16:23:21 user nova-compute[74131]:   <metadata>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:23:21 user nova-compute[74131]:   <nova:package version="0.0.0"/>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:creationTime>2023-10-20 16:23:20</nova:creationTime>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:flavor name="m1.tiny">
Oct 20 16:23:21 user nova-compute[74131]:     <nova:memory>512</nova:memory>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:disk>1</nova:disk>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:swap>0</nova:swap>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:vcpus>1</nova:vcpus>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:flavor>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:owner>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:owner>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:ports>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:23:21 user nova-compute[74131]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:23:21 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:ports>
Oct 20 16:23:21 user nova-compute[74131]: </nova:instance>
Oct 20 16:23:21 user nova-compute[74131]:   </metadata>
Oct 20 16:23:21 user nova-compute[74131]:   <memory unit='KiB'>524288</memory>
Oct 20 16:23:21 user nova-compute[74131]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 16:23:21 user nova-compute[74131]:   <vcpu placement='static'>1</vcpu>
Oct 20 16:23:21 user nova-compute[74131]:   <resource>
Oct 20 16:23:21 user nova-compute[74131]:     <partition>/machine</partition>
Oct 20 16:23:21 user nova-compute[74131]:   </resource>
Oct 20 16:23:21 user nova-compute[74131]:   <sysinfo type='smbios'>
Oct 20 16:23:21 user nova-compute[74131]:     <system>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='version'>0.0.0</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='serial'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='uuid'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='family'>Virtual Machine</entry>
Oct 20 16:23:21 user nova-compute[74131]:     </system>
Oct 20 16:23:21 user nova-compute[74131]:   </sysinfo>
Oct 20 16:23:21 user nova-compute[74131]:   <os>
Oct 20 16:23:21 user nova-compute[74131]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 16:23:21 user nova-compute[74131]:     <boot dev='hd'/>
Oct 20 16:23:21 user nova-compute[74131]:     <smbios mode='sysinfo'/>
Oct 20 16:23:21 user nova-compute[74131]:   </os>
Oct 20 16:23:21 user nova-compute[74131]:   <features>
Oct 20 16:23:21 user nova-compute[74131]:     <acpi/>
Oct 20 16:23:21 user nova-compute[74131]:     <apic/>
Oct 20 16:23:21 user nova-compute[74131]:     <vmcoreinfo state='on'/>
Oct 20 16:23:21 user nova-compute[74131]:   </features>
Oct 20 16:23:21 user nova-compute[74131]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 16:23:21 user nova-compute[74131]:     <model fallback='forbid'>Nehalem</model>
Oct 20 16:23:21 user nova-compute[74131]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 16:23:21 user nova-compute[74131]:     <feature policy='require' name='vme'/>
Oct 20 16:23:21 user nova-compute[74131]:     <feature policy='require' name='x2apic'/>
Oct 20 16:23:21 user nova-compute[74131]:     <feature policy='require' name='hypervisor'/>
Oct 20 16:23:21 user nova-compute[74131]:   </cpu>
Oct 20 16:23:21 user nova-compute[74131]:   <clock offset='utc'>
Oct 20 16:23:21 user nova-compute[74131]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 16:23:21 user nova-compute[74131]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 16:23:21 user nova-compute[74131]:     <timer name='hpet' present='no'/>
Oct 20 16:23:21 user nova-compute[74131]:   </clock>
Oct 20 16:23:21 user nova-compute[74131]:   <on_poweroff>destroy</on_poweroff>
Oct 20 16:23:21 user nova-compute[74131]:   <on_reboot>restart</on_reboot>
Oct 20 16:23:21 user nova-compute[74131]:   <on_crash>destroy</on_crash>
Oct 20 16:23:21 user nova-compute[74131]:   <devices>
Oct 20 16:23:21 user nova-compute[74131]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 16:23:21 user nova-compute[74131]:     <disk type='file' device='disk'>
Oct 20 16:23:21 user nova-compute[74131]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 16:23:21 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk' index='2'/>
Oct 20 16:23:21 user nova-compute[74131]:       <backingStore type='file' index='3'>
Oct 20 16:23:21 user nova-compute[74131]:         <format type='raw'/>
Oct 20 16:23:21 user nova-compute[74131]:         <source file='/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e'/>
Oct 20 16:23:21 user nova-compute[74131]:         <backingStore/>
Oct 20 16:23:21 user nova-compute[74131]:       </backingStore>
Oct 20 16:23:21 user nova-compute[74131]:       <target dev='vda' bus='virtio'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='virtio-disk0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </disk>
Oct 20 16:23:21 user nova-compute[74131]:     <disk type='file' device='cdrom'>
Oct 20 16:23:21 user nova-compute[74131]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 16:23:21 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config' index='1'/>
Oct 20 16:23:21 user nova-compute[74131]:       <backingStore/>
Oct 20 16:23:21 user nova-compute[74131]:       <target dev='hda' bus='ide'/>
Oct 20 16:23:21 user nova-compute[74131]:       <readonly/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='ide0-0-0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </disk>
Oct 20 16:23:21 user nova-compute[74131]:     <controller type='usb' index='0' model='none'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='usb'/>
Oct 20 16:23:21 user nova-compute[74131]:     </controller>
Oct 20 16:23:21 user nova-compute[74131]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='pci.0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </controller>
Oct 20 16:23:21 user nova-compute[74131]:     <controller type='ide' index='0'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='ide'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 16:23:21 user nova-compute[74131]:     </controller>
Oct 20 16:23:21 user nova-compute[74131]:     <interface type='ethernet'>
Oct 20 16:23:21 user nova-compute[74131]:       <mac address='fa:16:3e:7f:40:bb'/>
Oct 20 16:23:21 user nova-compute[74131]:       <target dev='tap846a2357-b3'/>
Oct 20 16:23:21 user nova-compute[74131]:       <model type='virtio'/>
Oct 20 16:23:21 user nova-compute[74131]:       <mtu size='1442'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='net0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </interface>
Oct 20 16:23:21 user nova-compute[74131]:     <serial type='pty'>
Oct 20 16:23:21 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:21 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:21 user nova-compute[74131]:       <target type='isa-serial' port='0'>
Oct 20 16:23:21 user nova-compute[74131]:         <model name='isa-serial'/>
Oct 20 16:23:21 user nova-compute[74131]:       </target>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </serial>
Oct 20 16:23:21 user nova-compute[74131]:     <console type='pty' tty='/dev/pts/2'>
Oct 20 16:23:21 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:21 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:21 user nova-compute[74131]:       <target type='serial' port='0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </console>
Oct 20 16:23:21 user nova-compute[74131]:     <input type='mouse' bus='ps2'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='input0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </input>
Oct 20 16:23:21 user nova-compute[74131]:     <input type='keyboard' bus='ps2'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='input1'/>
Oct 20 16:23:21 user nova-compute[74131]:     </input>
Oct 20 16:23:21 user nova-compute[74131]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Oct 20 16:23:21 user nova-compute[74131]:       <listen type='address' address='0.0.0.0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </graphics>
Oct 20 16:23:21 user nova-compute[74131]:     <audio id='1' type='none'/>
Oct 20 16:23:21 user nova-compute[74131]:     <video>
Oct 20 16:23:21 user nova-compute[74131]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='video0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </video>
Oct 20 16:23:21 user nova-compute[74131]:     <memballoon model='virtio'>
Oct 20 16:23:21 user nova-compute[74131]:       <stats period='10'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='balloon0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </memballoon>
Oct 20 16:23:21 user nova-compute[74131]:     <rng model='virtio'>
Oct 20 16:23:21 user nova-compute[74131]:       <backend model='random'>/dev/urandom</backend>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='rng0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </rng>
Oct 20 16:23:21 user nova-compute[74131]:   </devices>
Oct 20 16:23:21 user nova-compute[74131]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 16:23:21 user nova-compute[74131]:     <label>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</label>
Oct 20 16:23:21 user nova-compute[74131]:     <imagelabel>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</imagelabel>
Oct 20 16:23:21 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:21 user nova-compute[74131]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 16:23:21 user nova-compute[74131]:     <label>+64055:+108</label>
Oct 20 16:23:21 user nova-compute[74131]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 16:23:21 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:21 user nova-compute[74131]: </domain>
Oct 20 16:23:21 user nova-compute[74131]:  {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface> {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:00:0a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8bdb2f4e-29"/></interface>not found in domain: <domain type='kvm' id='3'>
Oct 20 16:23:21 user nova-compute[74131]:   <name>instance-00000003</name>
Oct 20 16:23:21 user nova-compute[74131]:   <uuid>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</uuid>
Oct 20 16:23:21 user nova-compute[74131]:   <metadata>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:23:21 user nova-compute[74131]:   <nova:package version="0.0.0"/>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:creationTime>2023-10-20 16:23:20</nova:creationTime>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:flavor name="m1.tiny">
Oct 20 16:23:21 user nova-compute[74131]:     <nova:memory>512</nova:memory>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:disk>1</nova:disk>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:swap>0</nova:swap>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:vcpus>1</nova:vcpus>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:flavor>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:owner>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:owner>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:ports>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:23:21 user nova-compute[74131]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:23:21 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:ports>
Oct 20 16:23:21 user nova-compute[74131]: </nova:instance>
Oct 20 16:23:21 user nova-compute[74131]:   </metadata>
Oct 20 16:23:21 user nova-compute[74131]:   <memory unit='KiB'>524288</memory>
Oct 20 16:23:21 user nova-compute[74131]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 16:23:21 user nova-compute[74131]:   <vcpu placement='static'>1</vcpu>
Oct 20 16:23:21 user nova-compute[74131]:   <resource>
Oct 20 16:23:21 user nova-compute[74131]:     <partition>/machine</partition>
Oct 20 16:23:21 user nova-compute[74131]:   </resource>
Oct 20 16:23:21 user nova-compute[74131]:   <sysinfo type='smbios'>
Oct 20 16:23:21 user nova-compute[74131]:     <system>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='version'>0.0.0</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='serial'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='uuid'>ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</entry>
Oct 20 16:23:21 user nova-compute[74131]:       <entry name='family'>Virtual Machine</entry>
Oct 20 16:23:21 user nova-compute[74131]:     </system>
Oct 20 16:23:21 user nova-compute[74131]:   </sysinfo>
Oct 20 16:23:21 user nova-compute[74131]:   <os>
Oct 20 16:23:21 user nova-compute[74131]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 16:23:21 user nova-compute[74131]:     <boot dev='hd'/>
Oct 20 16:23:21 user nova-compute[74131]:     <smbios mode='sysinfo'/>
Oct 20 16:23:21 user nova-compute[74131]:   </os>
Oct 20 16:23:21 user nova-compute[74131]:   <features>
Oct 20 16:23:21 user nova-compute[74131]:     <acpi/>
Oct 20 16:23:21 user nova-compute[74131]:     <apic/>
Oct 20 16:23:21 user nova-compute[74131]:     <vmcoreinfo state='on'/>
Oct 20 16:23:21 user nova-compute[74131]:   </features>
Oct 20 16:23:21 user nova-compute[74131]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 16:23:21 user nova-compute[74131]:     <model fallback='forbid'>Nehalem</model>
Oct 20 16:23:21 user nova-compute[74131]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 16:23:21 user nova-compute[74131]:     <feature policy='require' name='vme'/>
Oct 20 16:23:21 user nova-compute[74131]:     <feature policy='require' name='x2apic'/>
Oct 20 16:23:21 user nova-compute[74131]:     <feature policy='require' name='hypervisor'/>
Oct 20 16:23:21 user nova-compute[74131]:   </cpu>
Oct 20 16:23:21 user nova-compute[74131]:   <clock offset='utc'>
Oct 20 16:23:21 user nova-compute[74131]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 16:23:21 user nova-compute[74131]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 16:23:21 user nova-compute[74131]:     <timer name='hpet' present='no'/>
Oct 20 16:23:21 user nova-compute[74131]:   </clock>
Oct 20 16:23:21 user nova-compute[74131]:   <on_poweroff>destroy</on_poweroff>
Oct 20 16:23:21 user nova-compute[74131]:   <on_reboot>restart</on_reboot>
Oct 20 16:23:21 user nova-compute[74131]:   <on_crash>destroy</on_crash>
Oct 20 16:23:21 user nova-compute[74131]:   <devices>
Oct 20 16:23:21 user nova-compute[74131]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 16:23:21 user nova-compute[74131]:     <disk type='file' device='disk'>
Oct 20 16:23:21 user nova-compute[74131]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 16:23:21 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk' index='2'/>
Oct 20 16:23:21 user nova-compute[74131]:       <backingStore type='file' index='3'>
Oct 20 16:23:21 user nova-compute[74131]:         <format type='raw'/>
Oct 20 16:23:21 user nova-compute[74131]:         <source file='/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e'/>
Oct 20 16:23:21 user nova-compute[74131]:         <backingStore/>
Oct 20 16:23:21 user nova-compute[74131]:       </backingStore>
Oct 20 16:23:21 user nova-compute[74131]:       <target dev='vda' bus='virtio'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='virtio-disk0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </disk>
Oct 20 16:23:21 user nova-compute[74131]:     <disk type='file' device='cdrom'>
Oct 20 16:23:21 user nova-compute[74131]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 16:23:21 user nova-compute[74131]:       <source file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/disk.config' index='1'/>
Oct 20 16:23:21 user nova-compute[74131]:       <backingStore/>
Oct 20 16:23:21 user nova-compute[74131]:       <target dev='hda' bus='ide'/>
Oct 20 16:23:21 user nova-compute[74131]:       <readonly/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='ide0-0-0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </disk>
Oct 20 16:23:21 user nova-compute[74131]:     <controller type='usb' index='0' model='none'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='usb'/>
Oct 20 16:23:21 user nova-compute[74131]:     </controller>
Oct 20 16:23:21 user nova-compute[74131]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='pci.0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </controller>
Oct 20 16:23:21 user nova-compute[74131]:     <controller type='ide' index='0'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='ide'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 16:23:21 user nova-compute[74131]:     </controller>
Oct 20 16:23:21 user nova-compute[74131]:     <interface type='ethernet'>
Oct 20 16:23:21 user nova-compute[74131]:       <mac address='fa:16:3e:7f:40:bb'/>
Oct 20 16:23:21 user nova-compute[74131]:       <target dev='tap846a2357-b3'/>
Oct 20 16:23:21 user nova-compute[74131]:       <model type='virtio'/>
Oct 20 16:23:21 user nova-compute[74131]:       <mtu size='1442'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='net0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </interface>
Oct 20 16:23:21 user nova-compute[74131]:     <serial type='pty'>
Oct 20 16:23:21 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:21 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:21 user nova-compute[74131]:       <target type='isa-serial' port='0'>
Oct 20 16:23:21 user nova-compute[74131]:         <model name='isa-serial'/>
Oct 20 16:23:21 user nova-compute[74131]:       </target>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </serial>
Oct 20 16:23:21 user nova-compute[74131]:     <console type='pty' tty='/dev/pts/2'>
Oct 20 16:23:21 user nova-compute[74131]:       <source path='/dev/pts/2'/>
Oct 20 16:23:21 user nova-compute[74131]:       <log file='/opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477/console.log' append='off'/>
Oct 20 16:23:21 user nova-compute[74131]:       <target type='serial' port='0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='serial0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </console>
Oct 20 16:23:21 user nova-compute[74131]:     <input type='mouse' bus='ps2'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='input0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </input>
Oct 20 16:23:21 user nova-compute[74131]:     <input type='keyboard' bus='ps2'>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='input1'/>
Oct 20 16:23:21 user nova-compute[74131]:     </input>
Oct 20 16:23:21 user nova-compute[74131]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Oct 20 16:23:21 user nova-compute[74131]:       <listen type='address' address='0.0.0.0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </graphics>
Oct 20 16:23:21 user nova-compute[74131]:     <audio id='1' type='none'/>
Oct 20 16:23:21 user nova-compute[74131]:     <video>
Oct 20 16:23:21 user nova-compute[74131]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='video0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </video>
Oct 20 16:23:21 user nova-compute[74131]:     <memballoon model='virtio'>
Oct 20 16:23:21 user nova-compute[74131]:       <stats period='10'/>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='balloon0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </memballoon>
Oct 20 16:23:21 user nova-compute[74131]:     <rng model='virtio'>
Oct 20 16:23:21 user nova-compute[74131]:       <backend model='random'>/dev/urandom</backend>
Oct 20 16:23:21 user nova-compute[74131]:       <alias name='rng0'/>
Oct 20 16:23:21 user nova-compute[74131]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 16:23:21 user nova-compute[74131]:     </rng>
Oct 20 16:23:21 user nova-compute[74131]:   </devices>
Oct 20 16:23:21 user nova-compute[74131]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 16:23:21 user nova-compute[74131]:     <label>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</label>
Oct 20 16:23:21 user nova-compute[74131]:     <imagelabel>libvirt-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477</imagelabel>
Oct 20 16:23:21 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:21 user nova-compute[74131]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 16:23:21 user nova-compute[74131]:     <label>+64055:+108</label>
Oct 20 16:23:21 user nova-compute[74131]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 16:23:21 user nova-compute[74131]:   </seclabel>
Oct 20 16:23:21 user nova-compute[74131]: </domain>
Oct 20 16:23:21 user nova-compute[74131]:  {{(pid=74131) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 16:23:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Detaching interface fa:16:3e:3b:00:0a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8bdb2f4e-29' not found.
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.network.os_vif_util [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Converting VIF {"id": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "address": "fa:16:3e:3b:00:0a", "network": {"id": "573191ef-9917-4e3b-82eb-7a5431163596", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1031273308", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdb2f4e-29", "ovs_interfaceid": "8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.network.os_vif_util [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG os_vif [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bdb2f4e-29, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:23:21 user nova-compute[74131]: INFO os_vif [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:00:0a,bridge_name='br-int',has_traffic_filtering=True,id=8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce,network=Network(573191ef-9917-4e3b-82eb-7a5431163596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdb2f4e-29')
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [req-4d7e15ba-21d4-4a51-8eb6-3320c56d7676 req-d507433a-12f2-4e44-9efb-067897448146 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:23:21 user nova-compute[74131]:   <nova:package version="0.0.0"/>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:name>tempest-device-tagging-server-539612574</nova:name>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:creationTime>2023-10-20 16:23:21</nova:creationTime>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:flavor name="m1.tiny">
Oct 20 16:23:21 user nova-compute[74131]:     <nova:memory>512</nova:memory>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:disk>1</nova:disk>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:swap>0</nova:swap>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:vcpus>1</nova:vcpus>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:flavor>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:owner>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:user uuid="746522fa663e452a8dc8e027d4ada53e">tempest-TaggedAttachmentsTest-595633563-project-member</nova:user>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:project uuid="130aaa9f8cfd4f4da3ea514336679ef4">tempest-TaggedAttachmentsTest-595633563</nova:project>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:owner>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:23:21 user nova-compute[74131]:   <nova:ports>
Oct 20 16:23:21 user nova-compute[74131]:     <nova:port uuid="846a2357-b301-40b9-8bca-d3b22e092a24">
Oct 20 16:23:21 user nova-compute[74131]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:23:21 user nova-compute[74131]:     </nova:port>
Oct 20 16:23:21 user nova-compute[74131]:   </nova:ports>
Oct 20 16:23:21 user nova-compute[74131]: </nova:instance>
Oct 20 16:23:21 user nova-compute[74131]:  {{(pid=74131) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 16:23:21 user nova-compute[74131]: INFO nova.network.neutron [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Port 8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [{"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Releasing lock "refresh_cache-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6f298a6c-1474-4d7f-a823-8abce2b46dc5 tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "interface-ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-8bdb2f4e-299c-4c35-bc63-2fa2c5f1d7ce" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance eea7c78b-928f-4e65-956a-cb57026ef891 is timed out.
Oct 20 16:23:21 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Successfully detached device sdc from instance eea7c78b-928f-4e65-956a-cb57026ef891 from the live domain config.
Oct 20 16:23:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgDHCnEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:21 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:23:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f2f291-4d59-4407-b8a2-1e0e142727a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:23:21 user nova-compute[74131]: No targets found.
Oct 20 16:23:21 user nova-compute[74131]: iSNS:
Oct 20 16:23:21 user nova-compute[74131]: No targets found.
Oct 20 16:23:21 user nova-compute[74131]: STATIC:
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0
Oct 20 16:23:21 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:21 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:21 user nova-compute[74131]: FIRMWARE:
Oct 20 16:23:21 user nova-compute[74131]: No targets found.
Oct 20 16:23:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:23:21 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:23:21 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:23:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf7f82b-f9eb-4c38-9b47-668c88a93400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b154e680-f4a6-49f7-970d-755345bebfbc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:22 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:22 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8771990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0'): ({'sdc'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Removing single pathed devices sdc {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87a2763-764f-4b0e-8c02-25f9eb056340]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.038s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14ca074-18e1-4e32-8fe0-586c459c8723]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Flushing IO for device /dev/sdc {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b12d8c-7ce7-4269-852a-23dd93273ccd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2661c7eb-48b3-4b30-96ba-169374b746fb]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[29515bb1-cfb3-4bd5-9aad-c090a3a67de7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a150c26-f7c0-421d-b64e-81870ae59a57]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260]
Oct 20 16:23:22 user nova-compute[74131]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0, portal: 172.16.0.220,3260] successful.
Oct 20 16:23:22 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d74096c-47c0-477b-b3e7-52af8addd9e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[41078c01-b3ea-420d-85fe-8656da8d7d50]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] <== disconnect_volume: return (499ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:23:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:23:23 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe867561-330e-4ccd-a012-46d4420bcbaf is timed out.
Oct 20 16:23:23 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Successfully detached device vdb from instance fe867561-330e-4ccd-a012-46d4420bcbaf from the live domain config.
Oct 20 16:23:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbvIYEKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:23 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1bf3f6-e4f0-48a4-bda4-789b68c3eab7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:23:23 user nova-compute[74131]: No targets found.
Oct 20 16:23:23 user nova-compute[74131]: iSNS:
Oct 20 16:23:23 user nova-compute[74131]: No targets found.
Oct 20 16:23:23 user nova-compute[74131]: STATIC:
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:23:23 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:23:23 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:23:23 user nova-compute[74131]: FIRMWARE:
Oct 20 16:23:23 user nova-compute[74131]: No targets found.
Oct 20 16:23:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:23:23 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:23:23 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1721e409-8c89-418a-9b35-eb95211cdb2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc24ff96-deb1-436e-b167-ffc9036d1081]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:23 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c86d9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d'): ({'sdk'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Removing single pathed devices sdk {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90005db-e04d-4638-a1b7-42c68bdb3f8d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f7a0a7-5221-4e47-a314-3452ef53d998]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Flushing IO for device /dev/sdk {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3164f-eabc-4bd6-9cdb-2784e2aff380]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.043s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d0e0d-c944-4a93-9027-aba748106095]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] SCSI volumes sdk have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16037ae-301e-46c3-9ae5-63abf0494857]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG nova.objects.instance [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lazy-loading 'flavor' on Instance uuid eea7c78b-928f-4e65-956a-cb57026ef891 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2508cf06-b6d9-44e2-9d5d-b5726ec082de]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260]
Oct 20 16:23:23 user nova-compute[74131]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d, portal: 172.16.0.220,3260] successful.
Oct 20 16:23:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9f9ae5ac-6c0f-49bd-8566-d14cb7ebc42a tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.351s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3fec81f-4e5c-4565-bb16-166252e0812d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[533f87aa-582b-4c35-aaeb-22db0707c4ce]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] <== disconnect_volume: return (456ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:23:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG nova.objects.instance [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lazy-loading 'flavor' on Instance uuid fe867561-330e-4ccd-a012-46d4420bcbaf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-50cb5196-46da-438b-a998-a21ea1d173ce tempest-VolumesAssistedSnapshotsTest-490854498 tempest-VolumesAssistedSnapshotsTest-490854498-project-admin] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.699s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:25 user nova-compute[74131]: INFO nova.compute.manager [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Terminating instance
Oct 20 16:23:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-f2e77d0d-ba14-4450-a9a1-e8f43da3b4d6 req-ace484f5-72e8-43b0-ba80-20ce4bb30611 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-unplugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f2e77d0d-ba14-4450-a9a1-e8f43da3b4d6 req-ace484f5-72e8-43b0-ba80-20ce4bb30611 service nova] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f2e77d0d-ba14-4450-a9a1-e8f43da3b4d6 req-ace484f5-72e8-43b0-ba80-20ce4bb30611 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f2e77d0d-ba14-4450-a9a1-e8f43da3b4d6 req-ace484f5-72e8-43b0-ba80-20ce4bb30611 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-f2e77d0d-ba14-4450-a9a1-e8f43da3b4d6 req-ace484f5-72e8-43b0-ba80-20ce4bb30611 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] No waiting events found dispatching network-vif-unplugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-f2e77d0d-ba14-4450-a9a1-e8f43da3b4d6 req-ace484f5-72e8-43b0-ba80-20ce4bb30611 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-unplugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Instance destroyed successfully.
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lazy-loading 'resources' on Instance uuid eea7c78b-928f-4e65-956a-cb57026ef891 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1996108091',display_name='tempest-AttachSCSIVolumeTestJSON-server-1996108091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1996108091',id=4,image_ref='1be36b44-f88f-447d-b3da-c47f6f2af025',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJHSimtLxbgzGVf8hp0z6ie+dPIdGSTyoHvt3z2T6yV3upJWRjTgXyTi8w7EhLesNSjpGhrwnzTwKlkfC9i2hGxzzdDsgeIjuoslBXaaNG3KsIEEs40nw9q8thhNgI4Vw==',key_name='tempest-keypair-1819596975',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06df2eb0ad246c89ccdc5255b2bbdd6',ramdisk_id='',reservation_id='r-6p1ope3u',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1be36b44-f88f-447d-b3da-c47f6f2af025',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-250285697',owner_user_name='tempest-AttachSCSIVolumeTestJSON-250285697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d1d7d4655344bfbb847f91efacdcc2',uuid=eea7c78b-928f-4e65-956a-cb57026ef891,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Converting VIF {"id": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "address": "fa:16:3e:19:a3:09", "network": {"id": "ee41fac1-3f2e-4c40-aad3-2d9eecad539a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1985478207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06df2eb0ad246c89ccdc5255b2bbdd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9444f6-ea", "ovs_interfaceid": "7b9444f6-ea43-4322-9c80-b9d7988f8f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:a3:09,bridge_name='br-int',has_traffic_filtering=True,id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b,network=Network(ee41fac1-3f2e-4c40-aad3-2d9eecad539a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9444f6-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG os_vif [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a3:09,bridge_name='br-int',has_traffic_filtering=True,id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b,network=Network(ee41fac1-3f2e-4c40-aad3-2d9eecad539a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9444f6-ea') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b9444f6-ea, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86a04f94-7466-45f9-88d0-bd7e2c6fc85e) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:23:26 user nova-compute[74131]: INFO os_vif [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a3:09,bridge_name='br-int',has_traffic_filtering=True,id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b,network=Network(ee41fac1-3f2e-4c40-aad3-2d9eecad539a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9444f6-ea')
Oct 20 16:23:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Deleting instance files /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891_del
Oct 20 16:23:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Deletion of /opt/stack/data/nova/instances/eea7c78b-928f-4e65-956a-cb57026ef891_del complete
Oct 20 16:23:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:26 user nova-compute[74131]: INFO nova.compute.manager [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 20 16:23:26 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:23:26 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] No waiting events found dispatching network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:28 user nova-compute[74131]: WARNING nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received unexpected event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b for instance with vm_state active and task_state deleting.
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] No waiting events found dispatching network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:28 user nova-compute[74131]: WARNING nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received unexpected event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b for instance with vm_state active and task_state deleting.
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] No waiting events found dispatching network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:28 user nova-compute[74131]: WARNING nova.compute.manager [req-8eab178a-9b56-47d3-b23f-ea538a4096d0 req-fe889570-3180-4b91-bd02-5051c759e553 service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received unexpected event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b for instance with vm_state active and task_state deleting.
Oct 20 16:23:28 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Took 1.70 seconds to deallocate network for instance.
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-907f2938-456a-4c5f-ab08-0ae640ca47cd req-46c065ef-27e5-4c9d-9067-248914e8e7da service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-deleted-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:28 user nova-compute[74131]: INFO nova.compute.manager [req-907f2938-456a-4c5f-ab08-0ae640ca47cd req-46c065ef-27e5-4c9d-9067-248914e8e7da service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Neutron deleted interface 7b9444f6-ea43-4322-9c80-b9d7988f8f5b; detaching it from the instance and deleting it from the info cache
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-907f2938-456a-4c5f-ab08-0ae640ca47cd req-46c065ef-27e5-4c9d-9067-248914e8e7da service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-907f2938-456a-4c5f-ab08-0ae640ca47cd req-46c065ef-27e5-4c9d-9067-248914e8e7da service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Detach interface failed, port_id=7b9444f6-ea43-4322-9c80-b9d7988f8f5b, reason: Instance eea7c78b-928f-4e65-956a-cb57026ef891 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:23:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:28 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Deleted allocations for instance eea7c78b-928f-4e65-956a-cb57026ef891
Oct 20 16:23:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b3525670-be0b-4b8e-a90a-6281ed2f0aad tempest-AttachSCSIVolumeTestJSON-250285697 tempest-AttachSCSIVolumeTestJSON-250285697-project-member] Lock "eea7c78b-928f-4e65-956a-cb57026ef891" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.511s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "151335d8-e828-425b-8422-ba047749b204" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "151335d8-e828-425b-8422-ba047749b204" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:23:29 user nova-compute[74131]: INFO nova.compute.claims [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Claim successful on node user
Oct 20 16:23:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:23:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.policy [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '757415037269406cbc1dfe3de4465c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bc52c1d965465687699b8e0118300b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:23:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Creating image(s)
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "/opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "/opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "/opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-58513ce3-638e-43f4-8a54-11ccd545e1bc req-902924c7-3989-41b6-8228-302baafaddde service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58513ce3-638e-43f4-8a54-11ccd545e1bc req-902924c7-3989-41b6-8228-302baafaddde service nova] Acquiring lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58513ce3-638e-43f4-8a54-11ccd545e1bc req-902924c7-3989-41b6-8228-302baafaddde service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58513ce3-638e-43f4-8a54-11ccd545e1bc req-902924c7-3989-41b6-8228-302baafaddde service nova] Lock "eea7c78b-928f-4e65-956a-cb57026ef891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-58513ce3-638e-43f4-8a54-11ccd545e1bc req-902924c7-3989-41b6-8228-302baafaddde service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] No waiting events found dispatching network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:30 user nova-compute[74131]: WARNING nova.compute.manager [req-58513ce3-638e-43f4-8a54-11ccd545e1bc req-902924c7-3989-41b6-8228-302baafaddde service nova] [instance: eea7c78b-928f-4e65-956a-cb57026ef891] Received unexpected event network-vif-plugged-7b9444f6-ea43-4322-9c80-b9d7988f8f5b for instance with vm_state deleted and task_state None.
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk 1073741824" returned: 0 in 0.059s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Successfully created port: fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.264s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:23:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Cannot resize image /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Ensure instance console log exists: /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Successfully updated port: fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquired lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received event network-changed-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Refreshing instance network info cache due to event network-changed-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] Acquiring lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:23:31 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Updating instance_info_cache with network_info: [{"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Releasing lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Instance network_info: |[{"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] Acquired lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Refreshing network info cache for port fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Start _get_guest_xml network_info=[{"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:23:32 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:23:32 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505746337',display_name='tempest-ServersNegativeTestJSON-server-505746337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505746337',id=13,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5bc52c1d965465687699b8e0118300b',ramdisk_id='',reservation_id='r-pqhno65p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-270953747',owner_user_name='tempest-ServersNegativeTestJSON-270953747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:23:30Z,user_data=None,user_id='757415037269406cbc1dfe3de4465c53',uuid=151335d8-e828-425b-8422-ba047749b204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converting VIF {"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=fd5b62c4-93b6-4ac8-b2f0-6a8efe819634,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5b62c4-93') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lazy-loading 'pci_devices' on Instance uuid 151335d8-e828-425b-8422-ba047749b204 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:23:32 user nova-compute[74131]:   <uuid>151335d8-e828-425b-8422-ba047749b204</uuid>
Oct 20 16:23:32 user nova-compute[74131]:   <name>instance-0000000d</name>
Oct 20 16:23:32 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:23:32 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:23:32 user nova-compute[74131]:   <metadata>
Oct 20 16:23:32 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:23:32 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:23:32 user nova-compute[74131]:       <nova:name>tempest-ServersNegativeTestJSON-server-505746337</nova:name>
Oct 20 16:23:32 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:23:32</nova:creationTime>
Oct 20 16:23:32 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:23:32 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:23:32 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:23:32 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:23:32 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:23:32 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:23:32 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:23:32 user nova-compute[74131]:       <nova:owner>
Oct 20 16:23:32 user nova-compute[74131]:         <nova:user uuid="757415037269406cbc1dfe3de4465c53">tempest-ServersNegativeTestJSON-270953747-project-member</nova:user>
Oct 20 16:23:32 user nova-compute[74131]:         <nova:project uuid="a5bc52c1d965465687699b8e0118300b">tempest-ServersNegativeTestJSON-270953747</nova:project>
Oct 20 16:23:32 user nova-compute[74131]:       </nova:owner>
Oct 20 16:23:32 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:23:32 user nova-compute[74131]:       <nova:ports>
Oct 20 16:23:32 user nova-compute[74131]:         <nova:port uuid="fd5b62c4-93b6-4ac8-b2f0-6a8efe819634">
Oct 20 16:23:32 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 16:23:32 user nova-compute[74131]:         </nova:port>
Oct 20 16:23:32 user nova-compute[74131]:       </nova:ports>
Oct 20 16:23:32 user nova-compute[74131]:     </nova:instance>
Oct 20 16:23:32 user nova-compute[74131]:   </metadata>
Oct 20 16:23:32 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:23:32 user nova-compute[74131]:     <system>
Oct 20 16:23:32 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:23:32 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:23:32 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:23:32 user nova-compute[74131]:       <entry name="serial">151335d8-e828-425b-8422-ba047749b204</entry>
Oct 20 16:23:32 user nova-compute[74131]:       <entry name="uuid">151335d8-e828-425b-8422-ba047749b204</entry>
Oct 20 16:23:32 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:23:32 user nova-compute[74131]:     </system>
Oct 20 16:23:32 user nova-compute[74131]:   </sysinfo>
Oct 20 16:23:32 user nova-compute[74131]:   <os>
Oct 20 16:23:32 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:23:32 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:23:32 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:23:32 user nova-compute[74131]:   </os>
Oct 20 16:23:32 user nova-compute[74131]:   <features>
Oct 20 16:23:32 user nova-compute[74131]:     <acpi/>
Oct 20 16:23:32 user nova-compute[74131]:     <apic/>
Oct 20 16:23:32 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:23:32 user nova-compute[74131]:   </features>
Oct 20 16:23:32 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:23:32 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:23:32 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:23:32 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:23:32 user nova-compute[74131]:   </clock>
Oct 20 16:23:32 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:23:32 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:23:32 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:23:32 user nova-compute[74131]:   </cpu>
Oct 20 16:23:32 user nova-compute[74131]:   <devices>
Oct 20 16:23:32 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:23:32 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:23:32 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk"/>
Oct 20 16:23:32 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:23:32 user nova-compute[74131]:     </disk>
Oct 20 16:23:32 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:23:32 user nova-compute[74131]:       <mac address="fa:16:3e:e0:6f:d1"/>
Oct 20 16:23:32 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:23:32 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:23:32 user nova-compute[74131]:       <target dev="tapfd5b62c4-93"/>
Oct 20 16:23:32 user nova-compute[74131]:     </interface>
Oct 20 16:23:32 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:23:32 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/console.log" append="off"/>
Oct 20 16:23:32 user nova-compute[74131]:     </serial>
Oct 20 16:23:32 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:23:32 user nova-compute[74131]:     <video>
Oct 20 16:23:32 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:23:32 user nova-compute[74131]:     </video>
Oct 20 16:23:32 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:23:32 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:23:32 user nova-compute[74131]:     </rng>
Oct 20 16:23:32 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:23:32 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:23:32 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:23:32 user nova-compute[74131]:     </memballoon>
Oct 20 16:23:32 user nova-compute[74131]:   </devices>
Oct 20 16:23:32 user nova-compute[74131]: </domain>
Oct 20 16:23:32 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505746337',display_name='tempest-ServersNegativeTestJSON-server-505746337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505746337',id=13,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5bc52c1d965465687699b8e0118300b',ramdisk_id='',reservation_id='r-pqhno65p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-270953747',owner_user_name='tempest-ServersNegativeTestJSON-270953747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:23:30Z,user_data=None,user_id='757415037269406cbc1dfe3de4465c53',uuid=151335d8-e828-425b-8422-ba047749b204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converting VIF {"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=fd5b62c4-93b6-4ac8-b2f0-6a8efe819634,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5b62c4-93') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG os_vif [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=fd5b62c4-93b6-4ac8-b2f0-6a8efe819634,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5b62c4-93') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6321fcb7-f8ba-533c-8cc3-08f0e97e835e', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd5b62c4-93, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd5b62c4-93, col_values=(('qos', UUID('8d7aaf21-1ed4-41b6-a862-edbbe679881a')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd5b62c4-93, col_values=(('external_ids', {'iface-id': 'fd5b62c4-93b6-4ac8-b2f0-6a8efe819634', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:6f:d1', 'vm-uuid': '151335d8-e828-425b-8422-ba047749b204'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:32 user nova-compute[74131]: INFO os_vif [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=fd5b62c4-93b6-4ac8-b2f0-6a8efe819634,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5b62c4-93')
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] No VIF found with MAC fa:16:3e:e0:6f:d1, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Updated VIF entry in instance network info cache for port fd5b62c4-93b6-4ac8-b2f0-6a8efe819634. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Updating instance_info_cache with network_info: [{"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:23:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-74195293-3e8d-47cd-b299-a553f631a944 req-bade5805-6545-4746-8bb1-4e461a0acf8b service nova] Releasing lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:23:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-e4de0528-c1c6-4107-90b2-d1dcebba387b req-0dc919f3-8a45-435a-8b96-92b5e2916e7e service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received event network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e4de0528-c1c6-4107-90b2-d1dcebba387b req-0dc919f3-8a45-435a-8b96-92b5e2916e7e service nova] Acquiring lock "151335d8-e828-425b-8422-ba047749b204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e4de0528-c1c6-4107-90b2-d1dcebba387b req-0dc919f3-8a45-435a-8b96-92b5e2916e7e service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e4de0528-c1c6-4107-90b2-d1dcebba387b req-0dc919f3-8a45-435a-8b96-92b5e2916e7e service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-e4de0528-c1c6-4107-90b2-d1dcebba387b req-0dc919f3-8a45-435a-8b96-92b5e2916e7e service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] No waiting events found dispatching network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:34 user nova-compute[74131]: WARNING nova.compute.manager [req-e4de0528-c1c6-4107-90b2-d1dcebba387b req-0dc919f3-8a45-435a-8b96-92b5e2916e7e service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received unexpected event network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 for instance with vm_state building and task_state spawning.
Oct 20 16:23:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:23:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 151335d8-e828-425b-8422-ba047749b204] Instance spawned successfully.
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c8f051d-e51b-4714-a467-dfb1fbee923b req-59682dd2-fcb0-41f0-9c8f-a418f4eefd5e service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received event network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c8f051d-e51b-4714-a467-dfb1fbee923b req-59682dd2-fcb0-41f0-9c8f-a418f4eefd5e service nova] Acquiring lock "151335d8-e828-425b-8422-ba047749b204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c8f051d-e51b-4714-a467-dfb1fbee923b req-59682dd2-fcb0-41f0-9c8f-a418f4eefd5e service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c8f051d-e51b-4714-a467-dfb1fbee923b req-59682dd2-fcb0-41f0-9c8f-a418f4eefd5e service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c8f051d-e51b-4714-a467-dfb1fbee923b req-59682dd2-fcb0-41f0-9c8f-a418f4eefd5e service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] No waiting events found dispatching network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:23:36 user nova-compute[74131]: WARNING nova.compute.manager [req-3c8f051d-e51b-4714-a467-dfb1fbee923b req-59682dd2-fcb0-41f0-9c8f-a418f4eefd5e service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received unexpected event network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 for instance with vm_state building and task_state spawning.
Oct 20 16:23:36 user nova-compute[74131]: INFO nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Took 5.97 seconds to spawn the instance on the hypervisor.
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:23:36 user nova-compute[74131]: INFO nova.compute.manager [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Took 6.82 seconds to build instance.
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8abe846-21d9-4571-8d81-6057f2e486b2 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "151335d8-e828-425b-8422-ba047749b204" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.920s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytURqMmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:36 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:36 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:23:36 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d9bf2-a2de-4683-b52e-c52908fa8aa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:23:36 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2439bf74-2c50-44e1-a7d5-139981ddbef9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533] added
Oct 20 16:23:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c77de-a615-4fa7-bbac-b4a5949685bf]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[758695e2-f576-423c-98fe-06d7b2aaa665]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytURqMmT {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytURqMmT" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5856e8e-997a-4e34-b1f7-15959ce4aa77]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytURqMmT'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5bf83a-7567-4dd3-998e-b2a7b263c82a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2354019a-47cf-4803-95be-4105ebd3926b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[63282110-a610-4d77-be89-404410d5eabe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260]
Oct 20 16:23:36 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260] successful.
Oct 20 16:23:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8381cf1-9e5d-4635-a56f-b655d416a1a6]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d2fb16-a69a-42b1-b835-91e9a14ea8ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:23:36 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:23:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eccc57-ed63-4321-a37a-fb1cddee4747]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:23:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytURqMmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:23:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:23:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23839306461323031', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839306461323031', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:23:37 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'flavor' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:23:37 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:23:37 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:23:37 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:23:37 user nova-compute[74131]:   <serial>dcd49c92-69bf-4992-a70f-469c293bc533</serial>
Oct 20 16:23:37 user nova-compute[74131]: </disk>
Oct 20 16:23:37 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No VIF found with MAC fa:16:3e:6e:26:88, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f9ab78a5-5a93-452e-a467-cc3af778575c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.251s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 req-81050335-199f-4a61-b47c-773495391163 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event volume-reimaged-3c25cebe-bc8c-40af-81e6-4d28c5e7f158 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 req-81050335-199f-4a61-b47c-773495391163 service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 req-81050335-199f-4a61-b47c-773495391163 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 req-81050335-199f-4a61-b47c-773495391163 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 req-81050335-199f-4a61-b47c-773495391163 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Processing event volume-reimaged-3c25cebe-bc8c-40af-81e6-4d28c5e7f158 {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG nova.compute.manager [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance event wait completed in 36 seconds for volume-reimaged {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:23:38 user nova-compute[74131]: INFO nova.virt.block_device [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Booting with volume 3c25cebe-bc8c-40af-81e6-4d28c5e7f158 at /dev/vda
Oct 20 16:23:38 user nova-compute[74131]: DEBUG os_brick.utils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bbc873-d0ac-43e6-9b3e-4b590919ca0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c1c416-69c8-4738-944e-0527d454244c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[91034dbc-b5ea-4c3c-8d3e-6a3a9c576e35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6af400-807f-420a-b2f9-a957324bac0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:39 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:23:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[534aec2d-9fbc-4a48-a53f-030cc8f8b7fd]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG os_brick.utils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updating existing volume attachment record: 9d290d4f-d4ec-47f0-bdd4-64e5cafb0a3c {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:23:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'flavor' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:23:42 user nova-compute[74131]: INFO nova.compute.manager [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Attaching volume 7e695dba-9a44-4799-a45f-22c69f5919e5 to /dev/vdc
Oct 20 16:23:42 user nova-compute[74131]: DEBUG os_brick.utils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbfc166-9c38-436f-93f9-07bea84c0232]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1413d793-af2f-4915-85e1-04670a311d64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a10b8-9567-49af-b504-2a5f491f11ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c12fc1-abeb-485c-84c2-0282886649a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:23:43 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:23:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61aaef3-ecda-4d98-aca5-88b15149ce8d]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG os_brick.utils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:23:43 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updating existing volume attachment record: 799c89b0-e384-46eb-834d-6f934d2fe505 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:23:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:23:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INDOjTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:03 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:03 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:03 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[38374119-8cfc-4ce5-a605-b25ebd16b1e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:24:03 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db18a7e-ebf9-4ea9-98db-110104f5bb0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5] added
Oct 20 16:24:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2951a5c6-0d71-428f-826e-c35fef6af9da]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ac973-b2d2-42b7-b0ca-2934dd2ff59d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INDOjTVX {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INDOjTVX" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d203f6-21f9-4886-a102-aab5ffe4b103]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'INDOjTVX'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ab345f-3967-4eb0-8470-5680769a374d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4897e74c-14e6-43eb-906e-bb7c9d0de0ce]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc57aa-5930-40e6-bb41-4b12be926cdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260]
Oct 20 16:24:03 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e82bf-8038-4b5e-9197-b89df3e8df59]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d684666-4d0d-4f15-badf-ea90976040c2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:03 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1cb77a-1a75-483e-865e-e3d2619a133f]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:03 user nova-compute[74131]: INFO nova.compute.manager [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Terminating instance
Oct 20 16:24:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-87bddbae-0aa8-4010-86f8-809770f77233 req-c0c0f623-6c2a-4c45-9b08-c245d560ec99 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-unplugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87bddbae-0aa8-4010-86f8-809770f77233 req-c0c0f623-6c2a-4c45-9b08-c245d560ec99 service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87bddbae-0aa8-4010-86f8-809770f77233 req-c0c0f623-6c2a-4c45-9b08-c245d560ec99 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87bddbae-0aa8-4010-86f8-809770f77233 req-c0c0f623-6c2a-4c45-9b08-c245d560ec99 service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-87bddbae-0aa8-4010-86f8-809770f77233 req-c0c0f623-6c2a-4c45-9b08-c245d560ec99 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-unplugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-87bddbae-0aa8-4010-86f8-809770f77233 req-c0c0f623-6c2a-4c45-9b08-c245d560ec99 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-unplugged-846a2357-b301-40b9-8bca-d3b22e092a24 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INDOjTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23864363733663361', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864363733663361', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'flavor' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:24:04 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:04 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:24:04 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:24:04 user nova-compute[74131]:   <serial>7e695dba-9a44-4799-a45f-22c69f5919e5</serial>
Oct 20 16:24:04 user nova-compute[74131]: </disk>
Oct 20 16:24:04 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Instance destroyed successfully.
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lazy-loading 'resources' on Instance uuid ee67f6fa-6b81-46b5-a3cc-ef756c0ad477 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539612574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539612574',id=3,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSf8oReMYjYNYL2pGIYuTX2E37s7mWjHBL05jWTBnKQnK+G3o367P64m/7VX8aQUvdawPBAOyaTwv3wO/7LmVcP023Rq+g6PnCnoQ3RXjd5OqmpyfOMSnMbfWlJ9WzNQ==',key_name='tempest-keypair-1671442566',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='130aaa9f8cfd4f4da3ea514336679ef4',ramdisk_id='',reservation_id='r-p6qt3ovi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-595633563',owner_user_name='tempest-TaggedAttachmentsTest-595633563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='746522fa663e452a8dc8e027d4ada53e',uuid=ee67f6fa-6b81-46b5-a3cc-ef756c0ad477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converting VIF {"id": "846a2357-b301-40b9-8bca-d3b22e092a24", "address": "fa:16:3e:7f:40:bb", "network": {"id": "90cba9ff-7022-4987-9e13-0dff5c85a4a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1395733434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130aaa9f8cfd4f4da3ea514336679ef4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap846a2357-b3", "ovs_interfaceid": "846a2357-b301-40b9-8bca-d3b22e092a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:40:bb,bridge_name='br-int',has_traffic_filtering=True,id=846a2357-b301-40b9-8bca-d3b22e092a24,network=Network(90cba9ff-7022-4987-9e13-0dff5c85a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap846a2357-b3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG os_vif [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:40:bb,bridge_name='br-int',has_traffic_filtering=True,id=846a2357-b301-40b9-8bca-d3b22e092a24,network=Network(90cba9ff-7022-4987-9e13-0dff5c85a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap846a2357-b3') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap846a2357-b3, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23f49543-72f1-47a5-b35a-0a08768c0088) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:04 user nova-compute[74131]: INFO os_vif [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:40:bb,bridge_name='br-int',has_traffic_filtering=True,id=846a2357-b301-40b9-8bca-d3b22e092a24,network=Network(90cba9ff-7022-4987-9e13-0dff5c85a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap846a2357-b3')
Oct 20 16:24:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Deleting instance files /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477_del
Oct 20 16:24:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Deletion of /opt/stack/data/nova/instances/ee67f6fa-6b81-46b5-a3cc-ef756c0ad477_del complete
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] No VIF found with MAC fa:16:3e:6e:26:88, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:24:05 user nova-compute[74131]: INFO nova.compute.manager [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 20 16:24:05 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7eba3744-15fb-4ede-8563-4c35e1a6a969 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.340s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:05 user nova-compute[74131]: INFO nova.compute.manager [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Detaching volume 7e695dba-9a44-4799-a45f-22c69f5919e5
Oct 20 16:24:05 user nova-compute[74131]: INFO nova.virt.block_device [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Attempting to driver detach volume 7e695dba-9a44-4799-a45f-22c69f5919e5 from mountpoint /dev/vdc
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Attempting to detach device vdc from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:24:05 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:05 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:24:05 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:24:05 user nova-compute[74131]:   <serial>7e695dba-9a44-4799-a45f-22c69f5919e5</serial>
Oct 20 16:24:05 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 16:24:05 user nova-compute[74131]: </disk>
Oct 20 16:24:05 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:24:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Successfully detached device vdc from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the persistent domain config.
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:24:05 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:05 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:24:05 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:24:05 user nova-compute[74131]:   <serial>7e695dba-9a44-4799-a45f-22c69f5919e5</serial>
Oct 20 16:24:05 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 16:24:05 user nova-compute[74131]: </disk>
Oct 20 16:24:05 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:05 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Took 0.84 seconds to deallocate network for instance.
Oct 20 16:24:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-28d4441b-308e-427a-8cc0-3d127b4dee34 req-773eef85-ede1-4d9a-8121-4bc05d88dd48 service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-deleted-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-3dc1acf7-6a52-42c8-b34f-cc6191c7e4a9 req-e1638545-b17d-46e3-bc8b-4e31d2ad7f5f service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received event network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3dc1acf7-6a52-42c8-b34f-cc6191c7e4a9 req-e1638545-b17d-46e3-bc8b-4e31d2ad7f5f service nova] Acquiring lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3dc1acf7-6a52-42c8-b34f-cc6191c7e4a9 req-e1638545-b17d-46e3-bc8b-4e31d2ad7f5f service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3dc1acf7-6a52-42c8-b34f-cc6191c7e4a9 req-e1638545-b17d-46e3-bc8b-4e31d2ad7f5f service nova] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-3dc1acf7-6a52-42c8-b34f-cc6191c7e4a9 req-e1638545-b17d-46e3-bc8b-4e31d2ad7f5f service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] No waiting events found dispatching network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:06 user nova-compute[74131]: WARNING nova.compute.manager [req-3dc1acf7-6a52-42c8-b34f-cc6191c7e4a9 req-e1638545-b17d-46e3-bc8b-4e31d2ad7f5f service nova] [instance: ee67f6fa-6b81-46b5-a3cc-ef756c0ad477] Received unexpected event network-vif-plugged-846a2357-b301-40b9-8bca-d3b22e092a24 for instance with vm_state deleted and task_state None.
Oct 20 16:24:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:24:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:06 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Deleted allocations for instance ee67f6fa-6b81-46b5-a3cc-ef756c0ad477
Oct 20 16:24:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31dcec6a-c931-42e2-9c80-f03dd9508e0c tempest-TaggedAttachmentsTest-595633563 tempest-TaggedAttachmentsTest-595633563-project-member] Lock "ee67f6fa-6b81-46b5-a3cc-ef756c0ad477" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.662s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:24:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:24:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:24:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:14 user nova-compute[74131]: INFO nova.compute.manager [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Terminating instance
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updating instance_info_cache with network_info: [{"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a6f5e776-329d-4e3c-a18c-ca4a01789def" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-a74f5f28-c230-4745-85b4-982708070629 req-84290f49-57bb-48a6-816f-73f87e23a9af service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-vif-unplugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a74f5f28-c230-4745-85b4-982708070629 req-84290f49-57bb-48a6-816f-73f87e23a9af service nova] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a74f5f28-c230-4745-85b4-982708070629 req-84290f49-57bb-48a6-816f-73f87e23a9af service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a74f5f28-c230-4745-85b4-982708070629 req-84290f49-57bb-48a6-816f-73f87e23a9af service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-a74f5f28-c230-4745-85b4-982708070629 req-84290f49-57bb-48a6-816f-73f87e23a9af service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] No waiting events found dispatching network-vif-unplugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-a74f5f28-c230-4745-85b4-982708070629 req-84290f49-57bb-48a6-816f-73f87e23a9af service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-vif-unplugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Instance destroyed successfully.
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lazy-loading 'resources' on Instance uuid fe867561-330e-4ccd-a012-46d4420bcbaf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1984275987',display_name='tempest-VolumesAssistedSnapshotsTest-server-1984275987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1984275987',id=6,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrLc7dXT9RmL73/GdWei1ZnbVpp2GjoEY+RO3cx1rPc5dD/9basloB4UUuv7CcFlRo3G7zLjhHhGndHDE8Qh2B24mzv6WY7MdKiyYxGwGesKcBAUNh3RNYYJj9MNkol/Q==',key_name='tempest-keypair-1653230815',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6ab47cdc124a01b239914da533b04a',ramdisk_id='',reservation_id='r-mk30bsg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-59096444',owner_user_name='tempest-VolumesAssistedSnapshotsTest-59096444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5b50ea489fb4e1b85431adc0fadff01',uuid=fe867561-330e-4ccd-a012-46d4420bcbaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Converting VIF {"id": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "address": "fa:16:3e:87:d0:fc", "network": {"id": "baab4a05-0596-4ada-8bba-a3deae96c806", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-283446330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6ab47cdc124a01b239914da533b04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ea0f22-8e", "ovs_interfaceid": "29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:d0:fc,bridge_name='br-int',has_traffic_filtering=True,id=29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3,network=Network(baab4a05-0596-4ada-8bba-a3deae96c806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ea0f22-8e') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG os_vif [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:d0:fc,bridge_name='br-int',has_traffic_filtering=True,id=29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3,network=Network(baab4a05-0596-4ada-8bba-a3deae96c806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ea0f22-8e') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ea0f22-8e, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c269a66-d207-4e8e-9a3f-a3965f30e122) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:14 user nova-compute[74131]: INFO os_vif [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:d0:fc,bridge_name='br-int',has_traffic_filtering=True,id=29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3,network=Network(baab4a05-0596-4ada-8bba-a3deae96c806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ea0f22-8e')
Oct 20 16:24:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Deleting instance files /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf_del
Oct 20 16:24:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Deletion of /opt/stack/data/nova/instances/fe867561-330e-4ccd-a012-46d4420bcbaf_del complete
Oct 20 16:24:15 user nova-compute[74131]: INFO nova.compute.manager [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 16:24:15 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:15 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Took 0.96 seconds to deallocate network for instance.
Oct 20 16:24:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-ea13e295-32ef-4933-a267-b1d8a2d432ef req-2f47710b-2a65-4799-983e-228e394175e4 service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-vif-deleted-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:16 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Deleted allocations for instance fe867561-330e-4ccd-a012-46d4420bcbaf
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-1702694a-831e-4bc1-9bb2-3fefb0da064c req-bb1b5dd1-1184-4141-9439-48080a575faf service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received event network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1702694a-831e-4bc1-9bb2-3fefb0da064c req-bb1b5dd1-1184-4141-9439-48080a575faf service nova] Acquiring lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1702694a-831e-4bc1-9bb2-3fefb0da064c req-bb1b5dd1-1184-4141-9439-48080a575faf service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1702694a-831e-4bc1-9bb2-3fefb0da064c req-bb1b5dd1-1184-4141-9439-48080a575faf service nova] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-1702694a-831e-4bc1-9bb2-3fefb0da064c req-bb1b5dd1-1184-4141-9439-48080a575faf service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] No waiting events found dispatching network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:16 user nova-compute[74131]: WARNING nova.compute.manager [req-1702694a-831e-4bc1-9bb2-3fefb0da064c req-bb1b5dd1-1184-4141-9439-48080a575faf service nova] [instance: fe867561-330e-4ccd-a012-46d4420bcbaf] Received unexpected event network-vif-plugged-29ea0f22-8e3b-475f-a9b9-ac7f704cbfd3 for instance with vm_state deleted and task_state None.
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3d95a36-8eec-47dd-a87c-8b153c961a5e tempest-VolumesAssistedSnapshotsTest-59096444 tempest-VolumesAssistedSnapshotsTest-59096444-project-member] Lock "fe867561-330e-4ccd-a012-46d4420bcbaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:24:18 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:24:18 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7710MB free_disk=25.579391479492188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3e22a492-a812-415d-92c1-3cc51b842cc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6f5e776-329d-4e3c-a18c-ca4a01789def actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d2f0a264-c008-4a8d-a043-e3d391371e03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3308d7fc-97c0-4491-89da-b2c764637509 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:24:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:24:19 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:24:19 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:24:19 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:24:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6f5e776-329d-4e3c-a18c-ca4a01789def', 'attached_at': '', 'detached_at': '', 'volume_id': '119f7808-e6ad-43ab-abca-8c214cc87240', 'serial': '119f7808-e6ad-43ab-abca-8c214cc87240'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgRQpvdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '2839858f-1ded-44ed-bf91-69da4885562c'}, 'status': 'reserved', 'instance': 'a6f5e776-329d-4e3c-a18c-ca4a01789def', 'attached_at': '', 'detached_at': '', 'volume_id': '2839858f-1ded-44ed-bf91-69da4885562c', 'serial'} {{(pid=74131) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:20 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:20 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:20 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9879f7a6-56e8-4976-a199-909b4f859d61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:24:20 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8db4581-76f1-4621-9c19-5662ef3e72c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240] added
Oct 20 16:24:20 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a749e006-b83a-48b6-863b-1a5178563b37]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c382879-aa9d-4ac6-a055-3c0c034fa903]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLJxhMYF {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLJxhMYF" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aea6b8b-795f-42d8-9c29-4268f06655d6]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLJxhMYF'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd5f3a2-0308-48fc-b243-10f9df4b1009]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c24cf3b-ff2a-4411-a786-4b00bdca7499]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:20 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:20 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:24:21 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Creating image(s)
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Ensure instance console log exists: /opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Start _get_guest_xml network_info=[{"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9d290d4f-d4ec-47f0-bdd4-64e5cafb0a3c', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2f0a264-c008-4a8d-a043-e3d391371e03', 'attached_at': '', 'detached_at': '', 'volume_id': '3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'serial': '3c25cebe-bc8c-40af-81e6-4d28c5e7f158'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:24:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 16:24:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.objects.instance [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2f0a264-c008-4a8d-a043-e3d391371e03 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:21 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --login" returned: 0 in 1.102s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[627460d6-ddc5-4178-9d3c-b7a1850c9e5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]
Oct 20 16:24:21 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de2c875-7c25-4692-81a9-02bf94673540]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[feac25e0-cd0e-41e6-a8a6-572b06b4e6db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:21 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.368s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] HCTL ('42', '-', '-', 0) found on session 19 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.040s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03af640-ef7e-433e-8cbe-f4f6ecace33c]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Searching for a device in session 19 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:24:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:24:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:24:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.432s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] <== connect_volume: return (2434ms) {'type': 'block', 'scsi_wwn': '23138623235353966', 'path': '/dev/sdk'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138623235353966', 'path': '/dev/sdk'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:24:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.376s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:22 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:23 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lazy-loading 'flavor' on Instance uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7cafb-e746-4aa4-a987-24fd8bca9b74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:24:23 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fd4dad-6be8-4a1c-9e2f-35e247516881]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158] added
Oct 20 16:24:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b03c0ce-1373-4df4-951b-116d4f7c4099]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a84bf0b-2165-47d3-936c-bd9df5f29a58]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnoeEyXS {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnoeEyXS" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8355d07c-009b-4b0b-ae88-446bedfbc58c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RnoeEyXS'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf21a1d-bed3-4b71-8844-acdaaa74ca31]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c28e72e-9696-4f6f-983e-4d982b2f205a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b92d80-6fd6-4746-8d99-6751bd0ec63f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]
Oct 20 16:24:23 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe2bcd-4dfc-4263-8b18-199e392e5e9b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acf4cc5-49ba-4fff-98a4-835e60a18993]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:23 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] HCTL ('44', '-', '-', 0) found on session 20 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d7303-6803-41fa-a9a8-58027d102701]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Searching for a device in session 20 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:24:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] <== connect_volume: return (2866ms) {'type': 'block', 'scsi_wwn': '26463356233643339', 'path': '/dev/sdm'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463356233643339', 'path': '/dev/sdm'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1685753138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2143544802',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc4XMoxY4Dg+61kJ87kel36Y/5nH7VTQZrzEJv51BivlA49XZaf3Bj9QPbaGeYwls5bkzRLFgBw92nCYLyRqtpE8UqiU8SJyy2XjeM7IMfT3Enbm1zJVOMIEoid2i/ueQ==',key_name='tempest-keypair-694396898',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='271c255eceee494a88cb94ce0782cdac',ramdisk_id='',reservation_id='r-kb184yfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153044646',owner_user_name='tempest-ServerActionsV293TestJSON-153044646-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7afdf3b099374db9a370162d951c9f9c',uuid=d2f0a264-c008-4a8d-a043-e3d391371e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converting VIF {"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:24:24 user nova-compute[74131]:   <uuid>d2f0a264-c008-4a8d-a043-e3d391371e03</uuid>
Oct 20 16:24:24 user nova-compute[74131]:   <name>instance-00000008</name>
Oct 20 16:24:24 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:24:24 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:24:24 user nova-compute[74131]:   <metadata>
Oct 20 16:24:24 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:24:24 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:24:24 user nova-compute[74131]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1685753138</nova:name>
Oct 20 16:24:24 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:24:21</nova:creationTime>
Oct 20 16:24:24 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:24:24 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:24:24 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:24:24 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:24:24 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:24:24 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:24:24 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:24:24 user nova-compute[74131]:       <nova:owner>
Oct 20 16:24:24 user nova-compute[74131]:         <nova:user uuid="7afdf3b099374db9a370162d951c9f9c">tempest-ServerActionsV293TestJSON-153044646-project-member</nova:user>
Oct 20 16:24:24 user nova-compute[74131]:         <nova:project uuid="271c255eceee494a88cb94ce0782cdac">tempest-ServerActionsV293TestJSON-153044646</nova:project>
Oct 20 16:24:24 user nova-compute[74131]:       </nova:owner>
Oct 20 16:24:24 user nova-compute[74131]:       <nova:ports>
Oct 20 16:24:24 user nova-compute[74131]:         <nova:port uuid="c9e6dc02-3b44-4572-ba36-213377f08203">
Oct 20 16:24:24 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:24:24 user nova-compute[74131]:         </nova:port>
Oct 20 16:24:24 user nova-compute[74131]:       </nova:ports>
Oct 20 16:24:24 user nova-compute[74131]:     </nova:instance>
Oct 20 16:24:24 user nova-compute[74131]:   </metadata>
Oct 20 16:24:24 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:24:24 user nova-compute[74131]:     <system>
Oct 20 16:24:24 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:24:24 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:24:24 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:24:24 user nova-compute[74131]:       <entry name="serial">d2f0a264-c008-4a8d-a043-e3d391371e03</entry>
Oct 20 16:24:24 user nova-compute[74131]:       <entry name="uuid">d2f0a264-c008-4a8d-a043-e3d391371e03</entry>
Oct 20 16:24:24 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:24:24 user nova-compute[74131]:     </system>
Oct 20 16:24:24 user nova-compute[74131]:   </sysinfo>
Oct 20 16:24:24 user nova-compute[74131]:   <os>
Oct 20 16:24:24 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:24:24 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:24:24 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:24:24 user nova-compute[74131]:   </os>
Oct 20 16:24:24 user nova-compute[74131]:   <features>
Oct 20 16:24:24 user nova-compute[74131]:     <acpi/>
Oct 20 16:24:24 user nova-compute[74131]:     <apic/>
Oct 20 16:24:24 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:24:24 user nova-compute[74131]:   </features>
Oct 20 16:24:24 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:24:24 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:24:24 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:24:24 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:24:24 user nova-compute[74131]:   </clock>
Oct 20 16:24:24 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:24:24 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:24:24 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:24:24 user nova-compute[74131]:   </cpu>
Oct 20 16:24:24 user nova-compute[74131]:   <devices>
Oct 20 16:24:24 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:24:24 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:24 user nova-compute[74131]:       <source dev="/dev/sdm"/>
Oct 20 16:24:24 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:24:24 user nova-compute[74131]:       <serial>3c25cebe-bc8c-40af-81e6-4d28c5e7f158</serial>
Oct 20 16:24:24 user nova-compute[74131]:     </disk>
Oct 20 16:24:24 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:24:24 user nova-compute[74131]:       <mac address="fa:16:3e:89:15:de"/>
Oct 20 16:24:24 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:24:24 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:24:24 user nova-compute[74131]:       <target dev="tapc9e6dc02-3b"/>
Oct 20 16:24:24 user nova-compute[74131]:     </interface>
Oct 20 16:24:24 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:24:24 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03/console.log" append="off"/>
Oct 20 16:24:24 user nova-compute[74131]:     </serial>
Oct 20 16:24:24 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:24:24 user nova-compute[74131]:     <video>
Oct 20 16:24:24 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:24:24 user nova-compute[74131]:     </video>
Oct 20 16:24:24 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:24:24 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:24:24 user nova-compute[74131]:     </rng>
Oct 20 16:24:24 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:24:24 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:24:24 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:24:24 user nova-compute[74131]:     </memballoon>
Oct 20 16:24:24 user nova-compute[74131]:   </devices>
Oct 20 16:24:24 user nova-compute[74131]: </domain>
Oct 20 16:24:24 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1685753138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2143544802',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc4XMoxY4Dg+61kJ87kel36Y/5nH7VTQZrzEJv51BivlA49XZaf3Bj9QPbaGeYwls5bkzRLFgBw92nCYLyRqtpE8UqiU8SJyy2XjeM7IMfT3Enbm1zJVOMIEoid2i/ueQ==',key_name='tempest-keypair-694396898',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='271c255eceee494a88cb94ce0782cdac',ramdisk_id='',reservation_id='r-kb184yfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153044646',owner_user_name='tempest-ServerActionsV293TestJSON-153044646-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7afdf3b099374db9a370162d951c9f9c',uuid=d2f0a264-c008-4a8d-a043-e3d391371e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converting VIF {"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG os_vif [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fef64ed-8dd0-5a9e-b036-6f6a39786cd4', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9e6dc02-3b, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9e6dc02-3b, col_values=(('qos', UUID('ceec6a2f-f96b-4ad7-b483-847820de2acd')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9e6dc02-3b, col_values=(('external_ids', {'iface-id': 'c9e6dc02-3b44-4572-ba36-213377f08203', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:15:de', 'vm-uuid': 'd2f0a264-c008-4a8d-a043-e3d391371e03'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:24 user nova-compute[74131]: INFO os_vif [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b')
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:24:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] No VIF found with MAC fa:16:3e:89:15:de, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:24:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 364904448 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 381681664 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 522190848 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:26 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d is timed out.
Oct 20 16:24:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Successfully detached device vdc from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the live domain config.
Oct 20 16:24:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INDOjTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:26 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a851e75-424d-4cec-bdad-df85cdd38342]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:26 user nova-compute[74131]: No targets found.
Oct 20 16:24:26 user nova-compute[74131]: iSNS:
Oct 20 16:24:26 user nova-compute[74131]: No targets found.
Oct 20 16:24:26 user nova-compute[74131]: STATIC:
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:24:26 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:26 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:26 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:26 user nova-compute[74131]: No targets found.
Oct 20 16:24:26 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:26 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:26 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3bb47c-7bf3-4aea-81f8-48665b79d92b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[050190cd-d137-4909-a743-081d1e6e5331]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:26 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:26 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c82d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5'): ({'sdc'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Removing single pathed devices sdc {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c983cd-025d-42d0-a110-bd482773460d]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[814a32ce-7b9a-4c90-aa49-086939ac617c]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Flushing IO for device /dev/sdc {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b087dd87-5695-4cb3-94ad-a9578f48438c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 639631360 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a219b-cd65-40a5-82d3-1d50eb93b70a]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8593f-9a75-41c3-92f0-b42194178897]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.130s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c682357d-3187-4475-82dd-193b1d023819]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260]
Oct 20 16:24:26 user nova-compute[74131]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:26 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e695dba-9a44-4799-a45f-22c69f5919e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.074s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bc60ec-69c5-4c8b-911c-e4e981be5e1c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] <== disconnect_volume: return (527ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-b6523e72-28fa-4c9e-b62e-21d370fdd1d3 req-e0b27a5a-8719-41e3-9930-8c6c058fa642 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b6523e72-28fa-4c9e-b62e-21d370fdd1d3 req-e0b27a5a-8719-41e3-9930-8c6c058fa642 service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b6523e72-28fa-4c9e-b62e-21d370fdd1d3 req-e0b27a5a-8719-41e3-9930-8c6c058fa642 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b6523e72-28fa-4c9e-b62e-21d370fdd1d3 req-e0b27a5a-8719-41e3-9930-8c6c058fa642 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-b6523e72-28fa-4c9e-b62e-21d370fdd1d3 req-e0b27a5a-8719-41e3-9930-8c6c058fa642 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:27 user nova-compute[74131]: WARNING nova.compute.manager [req-b6523e72-28fa-4c9e-b62e-21d370fdd1d3 req-e0b27a5a-8719-41e3-9930-8c6c058fa642 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received unexpected event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 16:24:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 792723456 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 896532480 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 1015021568 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG nova.objects.instance [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'flavor' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-64354233-b0e6-467a-959d-91d1d078355c tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.667s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgRQpvdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '2839858f-1ded-44ed-bf91-69da4885562c'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:28 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-changed-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Refreshing instance network info cache due to event network-changed-0532a160-3c88-4853-83ce-a1fe7b648d22. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] Acquiring lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] Acquired lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Refreshing network info cache for port 0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aebd69-310c-412e-a27d-fe1a99f178cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:28 user nova-compute[74131]: No targets found.
Oct 20 16:24:28 user nova-compute[74131]: iSNS:
Oct 20 16:24:28 user nova-compute[74131]: No targets found.
Oct 20 16:24:28 user nova-compute[74131]: STATIC:
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:24:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:28 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:28 user nova-compute[74131]: No targets found.
Oct 20 16:24:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:28 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:28 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[388bb973-178e-4a2d-8e15-3ca092b3166d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[42993da6-5df4-44e6-950e-988b8b57ab39]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:28 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e00f7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c'): ({'sdl'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Removing single pathed devices sdl {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[59734bf0-1e7c-44fd-a6ea-3d8e8a2d3895]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba13e01-2aab-4a62-b876-3b83e217dc34]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Flushing IO for device /dev/sdl {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a75824-0cd1-453b-ae3f-b4fc0d668e74]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd55432-3787-42cb-9a89-afb9fd3dc3f1]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] SCSI volumes sdl have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ea68dd-0bd0-46e6-a44e-fcf70dacc79e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[803211e2-ba6a-4712-8a7e-c05e09a104a2]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260]
Oct 20 16:24:29 user nova-compute[74131]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2839858f-1ded-44ed-bf91-69da4885562c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9c9f32-bc24-4da4-8342-aa558f0631ad]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] <== disconnect_volume: return (423ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-98b1906f-76de-4cdc-a314-efe104e5e0bf req-dfe8fa58-88b8-46bc-8de8-220c67cc7ad1 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-98b1906f-76de-4cdc-a314-efe104e5e0bf req-dfe8fa58-88b8-46bc-8de8-220c67cc7ad1 service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-98b1906f-76de-4cdc-a314-efe104e5e0bf req-dfe8fa58-88b8-46bc-8de8-220c67cc7ad1 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-98b1906f-76de-4cdc-a314-efe104e5e0bf req-dfe8fa58-88b8-46bc-8de8-220c67cc7ad1 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-98b1906f-76de-4cdc-a314-efe104e5e0bf req-dfe8fa58-88b8-46bc-8de8-220c67cc7ad1 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:29 user nova-compute[74131]: WARNING nova.compute.manager [req-98b1906f-76de-4cdc-a314-efe104e5e0bf req-dfe8fa58-88b8-46bc-8de8-220c67cc7ad1 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received unexpected event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'a6f5e776-329d-4e3c-a18c-ca4a01789def', 'attached_at': '', 'detached_at': '', 'volume_id': '119f7808-e6ad-43ab-abca-8c214cc87240', 'serial'} {{(pid=74131) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] swap_volume: removing Cinder connection for volume 2839858f-1ded-44ed-bf91-69da4885562c {{(pid=74131) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:29 user nova-compute[74131]: INFO nova.compute.manager [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Terminating instance
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Updated VIF entry in instance network info cache for port 0532a160-3c88-4853-83ce-a1fe7b648d22. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Updating instance_info_cache with network_info: [{"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:24:29 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance spawned successfully.
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63198b46-4651-4436-a931-b875febfd76f req-d83c6462-454d-4f50-97ca-3fab2dfc6688 service nova] Releasing lock "refresh_cache-20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG nova.objects.instance [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74131) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04d64386-d8b2-4a3c-9d0c-bf900d06e2f2 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.120s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Instance destroyed successfully.
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'resources' on Instance uuid 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-306988643',display_name='tempest-AttachVolumeNegativeTest-server-306988643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-306988643',id=12,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc9h69YrUjj330jdlyuYiprSMjgBTlFqJxih7vZT0m1UOR1Z90VQg+ho8+sWv+L52dYiD5xnTMBVss3tY5kjFW+FlWYpXY27ZXewyv1tmK+g0lKn0Cz5msI6HFAvh1jWA==',key_name='tempest-keypair-1118395557',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-d52h726u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "0532a160-3c88-4853-83ce-a1fe7b648d22", "address": "fa:16:3e:ab:11:b9", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0532a160-3c", "ovs_interfaceid": "0532a160-3c88-4853-83ce-a1fe7b648d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:11:b9,bridge_name='br-int',has_traffic_filtering=True,id=0532a160-3c88-4853-83ce-a1fe7b648d22,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0532a160-3c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG os_vif [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:11:b9,bridge_name='br-int',has_traffic_filtering=True,id=0532a160-3c88-4853-83ce-a1fe7b648d22,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0532a160-3c') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0532a160-3c, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=715edac7-e7a1-4348-b721-55adce1ca4e8) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:30 user nova-compute[74131]: INFO os_vif [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:11:b9,bridge_name='br-int',has_traffic_filtering=True,id=0532a160-3c88-4853-83ce-a1fe7b648d22,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0532a160-3c')
Oct 20 16:24:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Deleting instance files /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74_del
Oct 20 16:24:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Deletion of /opt/stack/data/nova/instances/20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74_del complete
Oct 20 16:24:30 user nova-compute[74131]: INFO nova.compute.manager [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] swap_volume: Updating volume 2839858f-1ded-44ed-bf91-69da4885562c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "uLJxhMYF", "auth_password": "bf2dge9IjkTnRi", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "119f7808-e6ad-43ab-abca-8c214cc87240"}, "status": "reserved", "instance": "a6f5e776-329d-4e3c-a18c-ca4a01789def", "attached_at": "", "detached_at": "", "volume_id": "119f7808-e6ad-43ab-abca-8c214cc87240", "serial": "119f7808-e6ad-43ab-abca-8c214cc87240"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '119f7808-e6ad-43ab-abca-8c214cc87240', 'no_device': None, 'attachment_id': '4cff21a6-5e7c-41dc-97ff-b638c8b0abe2'} {{(pid=74131) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e75c82e3-d4bf-4698-94b9-0c198365adc6 tempest-TestVolumeSwap-422997034 tempest-TestVolumeSwap-422997034-project-admin] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 71.218s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-vif-unplugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] Acquiring lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] No waiting events found dispatching network-vif-unplugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-vif-unplugged-0532a160-3c88-4853-83ce-a1fe7b648d22 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] Acquiring lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] No waiting events found dispatching network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:30 user nova-compute[74131]: WARNING nova.compute.manager [req-c04fd4d6-8f7c-4d62-8bee-416ff1b643ec req-1bb04183-e4c9-40f1-9315-6be529eaca3c service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received unexpected event network-vif-plugged-0532a160-3c88-4853-83ce-a1fe7b648d22 for instance with vm_state active and task_state deleting.
Oct 20 16:24:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:31 user nova-compute[74131]: INFO nova.compute.manager [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Detaching volume 119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:31 user nova-compute[74131]: INFO nova.virt.block_device [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Attempting to driver detach volume 119f7808-e6ad-43ab-abca-8c214cc87240 from mountpoint /dev/vdb
Oct 20 16:24:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Attempting to detach device vdb from instance a6f5e776-329d-4e3c-a18c-ca4a01789def from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:24:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:24:31 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:31 user nova-compute[74131]:   <source dev="/dev/sdk"/>
Oct 20 16:24:31 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:24:31 user nova-compute[74131]:   <serial>119f7808-e6ad-43ab-abca-8c214cc87240</serial>
Oct 20 16:24:31 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:24:31 user nova-compute[74131]: </disk>
Oct 20 16:24:31 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:24:31 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Successfully detached device vdb from instance a6f5e776-329d-4e3c-a18c-ca4a01789def from the persistent domain config.
Oct 20 16:24:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6f5e776-329d-4e3c-a18c-ca4a01789def from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:24:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:24:31 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:31 user nova-compute[74131]:   <source dev="/dev/sdk"/>
Oct 20 16:24:31 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:24:31 user nova-compute[74131]:   <serial>119f7808-e6ad-43ab-abca-8c214cc87240</serial>
Oct 20 16:24:31 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:24:31 user nova-compute[74131]: </disk>
Oct 20 16:24:31 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:24:31 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:31 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Took 1.40 seconds to deallocate network for instance.
Oct 20 16:24:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-a6bf2077-1070-4bdd-a7a6-3b3b2e70166f req-5d394cef-a0e3-4dea-931d-a8850fb86c5b service nova] [instance: 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74] Received event network-vif-deleted-0532a160-3c88-4853-83ce-a1fe7b648d22 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:24:32 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:24:32 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:24:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:32 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Deleted allocations for instance 20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74
Oct 20 16:24:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5816d21d-e21e-489a-9431-d7739681c3ae tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "20e4b0e9-3cb6-45ff-acb5-6be47d4a0a74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-changed-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing instance network info cache due to event network-changed-99757533-e66b-4bc8-97d0-7d48f34782bf. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:24:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] Acquiring lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:24:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] Acquired lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:24:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Refreshing network info cache for port 99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:24:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updated VIF entry in instance network info cache for port 99757533-e66b-4bc8-97d0-7d48f34782bf. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:24:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07c81ce5-fdf2-40ac-8426-e21b767887b1 req-a2db09eb-ffe1-4fb5-9003-8c79be2c0e33 service nova] Releasing lock "refresh_cache-a6903514-5d6a-4954-bb2d-a5da5d5624ca" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:24:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-changed-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing instance network info cache due to event network-changed-1bf41897-28d2-4330-9306-804c943a8411. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] Acquiring lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] Acquired lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Refreshing network info cache for port 1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updated VIF entry in instance network info cache for port 1bf41897-28d2-4330-9306-804c943a8411. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1959425c-1e7c-405d-840b-f4d52ce62864 req-801726db-5f82-467b-8db7-78ba9ecb4239 service nova] Releasing lock "refresh_cache-3308d7fc-97c0-4491-89da-b2c764637509" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:45 user nova-compute[74131]: INFO nova.compute.manager [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Terminating instance
Oct 20 16:24:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-b0b2ada8-fa97-435a-aed8-4ceff189e289 req-d24c7b44-4df3-4baa-919f-e353ad543251 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b0b2ada8-fa97-435a-aed8-4ceff189e289 req-d24c7b44-4df3-4baa-919f-e353ad543251 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b0b2ada8-fa97-435a-aed8-4ceff189e289 req-d24c7b44-4df3-4baa-919f-e353ad543251 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b0b2ada8-fa97-435a-aed8-4ceff189e289 req-d24c7b44-4df3-4baa-919f-e353ad543251 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-b0b2ada8-fa97-435a-aed8-4ceff189e289 req-d24c7b44-4df3-4baa-919f-e353ad543251 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-unplugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-b0b2ada8-fa97-435a-aed8-4ceff189e289 req-d24c7b44-4df3-4baa-919f-e353ad543251 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-99757533-e66b-4bc8-97d0-7d48f34782bf for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-dc079d10-f313-4dfe-9dde-aacbc66179b8 req-ab92969b-3288-499b-b729-0b24f4b56ae1 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dc079d10-f313-4dfe-9dde-aacbc66179b8 req-ab92969b-3288-499b-b729-0b24f4b56ae1 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dc079d10-f313-4dfe-9dde-aacbc66179b8 req-ab92969b-3288-499b-b729-0b24f4b56ae1 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dc079d10-f313-4dfe-9dde-aacbc66179b8 req-ab92969b-3288-499b-b729-0b24f4b56ae1 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-dc079d10-f313-4dfe-9dde-aacbc66179b8 req-ab92969b-3288-499b-b729-0b24f4b56ae1 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-unplugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-dc079d10-f313-4dfe-9dde-aacbc66179b8 req-ab92969b-3288-499b-b729-0b24f4b56ae1 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a5c275f1-5b09-4cf8-8590-8971595a828c for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-unplugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:47 user nova-compute[74131]: WARNING nova.compute.manager [req-a7d3e7bd-f5b6-4373-aaa3-1e5a161d4a57 req-dd319ade-51a2-4084-a668-04d5ae238a13 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a567a97b-c472-4481-97db-7d7a4ef92ec1 for instance with vm_state active and task_state deleting.
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Instance destroyed successfully.
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lazy-loading 'resources' on Instance uuid a6903514-5d6a-4954-bb2d-a5da5d5624ca {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:13,bridge_name='br-int',has_traffic_filtering=True,id=99757533-e66b-4bc8-97d0-7d48f34782bf,network=Network(f76591c7-6b7b-4f84-b36a-73c78453670a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99757533-e6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:13,bridge_name='br-int',has_traffic_filtering=True,id=99757533-e66b-4bc8-97d0-7d48f34782bf,network=Network(f76591c7-6b7b-4f84-b36a-73c78453670a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99757533-e6') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99757533-e6, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c706ff7-c475-4b76-9fad-bbe4622296e2) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: INFO os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:13,bridge_name='br-int',has_traffic_filtering=True,id=99757533-e66b-4bc8-97d0-7d48f34782bf,network=Network(f76591c7-6b7b-4f84-b36a-73c78453670a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99757533-e6')
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:07:87,bridge_name='br-int',has_traffic_filtering=True,id=5c568f79-cd10-49f5-83a9-b3c375a11c51,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c568f79-cd') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:07:87,bridge_name='br-int',has_traffic_filtering=True,id=5c568f79-cd10-49f5-83a9-b3c375a11c51,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c568f79-cd') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c568f79-cd, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=571005bc-9c0f-412d-88e2-1c2fc18539e5) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "3308d7fc-97c0-4491-89da-b2c764637509" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: INFO nova.compute.manager [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Terminating instance
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: INFO os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:07:87,bridge_name='br-int',has_traffic_filtering=True,id=5c568f79-cd10-49f5-83a9-b3c375a11c51,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c568f79-cd')
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b2:98,bridge_name='br-int',has_traffic_filtering=True,id=a5c275f1-5b09-4cf8-8590-8971595a828c,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c275f1-5b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b2:98,bridge_name='br-int',has_traffic_filtering=True,id=a5c275f1-5b09-4cf8-8590-8971595a828c,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c275f1-5b') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5c275f1-5b, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c2e6942-d64c-4988-b8bc-0b39937849cc) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: INFO os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b2:98,bridge_name='br-int',has_traffic_filtering=True,id=a5c275f1-5b09-4cf8-8590-8971595a828c,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c275f1-5b')
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a156a317-1011-417d-b4da-199d79eca471", "address": "fa:16:3e:20:43:c2", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa156a317-10", "ovs_interfaceid": "a156a317-1011-417d-b4da-199d79eca471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=a156a317-1011-417d-b4da-199d79eca471,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa156a317-10') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=a156a317-1011-417d-b4da-199d79eca471,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa156a317-10') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa156a317-10, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: WARNING nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-99757533-e66b-4bc8-97d0-7d48f34782bf for instance with vm_state active and task_state deleting.
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-unplugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: WARNING nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-5c568f79-cd10-49f5-83a9-b3c375a11c51 for instance with vm_state active and task_state deleting.
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-unplugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a156a317-1011-417d-b4da-199d79eca471 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: WARNING nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a156a317-1011-417d-b4da-199d79eca471 for instance with vm_state active and task_state deleting.
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-unplugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-a146d40a-536f-4bec-8a48-d162c51c818e for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: WARNING nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a146d40a-536f-4bec-8a48-d162c51c818e for instance with vm_state active and task_state deleting.
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-unplugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-baf24ac7-30c6-49b0-a548-dd696a33e5be req-309a2f94-47b2-4a90-a02e-2cd023dc79c4 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-unplugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=706979a9-03d4-4142-8f8c-a598857f9f85) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: INFO os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=a156a317-1011-417d-b4da-199d79eca471,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa156a317-10')
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:a7:71,bridge_name='br-int',has_traffic_filtering=True,id=a146d40a-536f-4bec-8a48-d162c51c818e,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa146d40a-53') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:a7:71,bridge_name='br-int',has_traffic_filtering=True,id=a146d40a-536f-4bec-8a48-d162c51c818e,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa146d40a-53') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa146d40a-53, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: WARNING nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-a5c275f1-5b09-4cf8-8590-8971595a828c for instance with vm_state active and task_state deleting.
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-unplugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-1bf41897-28d2-4330-9306-804c943a8411 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:48 user nova-compute[74131]: WARNING nova.compute.manager [req-a882f035-c30f-443a-bcc7-64c5acf3ca81 req-822d0759-6d54-40d3-a702-5c9b96ef7912 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-1bf41897-28d2-4330-9306-804c943a8411 for instance with vm_state active and task_state deleting.
Oct 20 16:24:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=992f1710-3b82-4b03-98c0-29b9c0d5ce40) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: INFO os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:a7:71,bridge_name='br-int',has_traffic_filtering=True,id=a146d40a-536f-4bec-8a48-d162c51c818e,network=Network(8f60e819-8275-4d69-aa45-36c9d91b7398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa146d40a-53')
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:42:cf,bridge_name='br-int',has_traffic_filtering=True,id=a567a97b-c472-4481-97db-7d7a4ef92ec1,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa567a97b-c4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:42:cf,bridge_name='br-int',has_traffic_filtering=True,id=a567a97b-c472-4481-97db-7d7a4ef92ec1,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa567a97b-c4') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa567a97b-c4, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-5c9f7c01-9320-4e03-8392-17f872c808c6 req-0db9c480-db69-4954-bb11-16bae09c108e service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5c9f7c01-9320-4e03-8392-17f872c808c6 req-0db9c480-db69-4954-bb11-16bae09c108e service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5c9f7c01-9320-4e03-8392-17f872c808c6 req-0db9c480-db69-4954-bb11-16bae09c108e service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5c9f7c01-9320-4e03-8392-17f872c808c6 req-0db9c480-db69-4954-bb11-16bae09c108e service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-5c9f7c01-9320-4e03-8392-17f872c808c6 req-0db9c480-db69-4954-bb11-16bae09c108e service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-unplugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-5c9f7c01-9320-4e03-8392-17f872c808c6 req-0db9c480-db69-4954-bb11-16bae09c108e service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1baa6179-c788-425a-ae1b-e8e06ef6181f) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: INFO os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:42:cf,bridge_name='br-int',has_traffic_filtering=True,id=a567a97b-c472-4481-97db-7d7a4ef92ec1,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa567a97b-c4')
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1570442189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1570442189',id=9,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopRjO412fDpCX61cIxBWugHL56lAZs2WYc25mif4odLhs9s8fwGW3D8PJcqlmxcROG3S0THtcdvVLIDaxWeYo8ruA+QbZtSjLgO0/BZvPXCnDKyvLKveGlWcUDWcnYVA==',key_name='tempest-keypair-511999580',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7731c7dd721a4ffca10b9a305aedc1e6',ramdisk_id='',reservation_id='r-ba96bzb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1757416359',owner_user_name='tempest-TaggedBootDevicesTest_v242-1757416359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9c73d128c04e65a98bf1beb30b5a94',uuid=a6903514-5d6a-4954-bb2d-a5da5d5624ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converting VIF {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a8:15,bridge_name='br-int',has_traffic_filtering=True,id=c1f7bff5-067d-4e94-9703-b3a03102c6bb,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f7bff5-06') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a8:15,bridge_name='br-int',has_traffic_filtering=True,id=c1f7bff5-067d-4e94-9703-b3a03102c6bb,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f7bff5-06') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1f7bff5-06, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e60f2706-f361-44ca-9db6-610aee1c2556) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Instance destroyed successfully.
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.objects.instance [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lazy-loading 'resources' on Instance uuid 3308d7fc-97c0-4491-89da-b2c764637509 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a8:15,bridge_name='br-int',has_traffic_filtering=True,id=c1f7bff5-067d-4e94-9703-b3a03102c6bb,network=Network(3bb0fe81-6261-4641-a527-c4d73bf7197c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f7bff5-06')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imNXVHud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:b4:46,bridge_name='br-int',has_traffic_filtering=True,id=1bf41897-28d2-4330-9306-804c943a8411,network=Network(2fd9399b-b8f9-4756-80c7-dfae9c8e6edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf41897-28') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:b4:46,bridge_name='br-int',has_traffic_filtering=True,id=1bf41897-28d2-4330-9306-804c943a8411,network=Network(2fd9399b-b8f9-4756-80c7-dfae9c8e6edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf41897-28') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bf41897-28, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64a15d-e74e-4464-8a1a-dcb6cf217f87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]: iSNS:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]: STATIC:
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:50 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:50 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab04434-e10c-4ee5-ae18-4ade59109583]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[696acb57-5538-435f-af23-01e8f5f92c13]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a877a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192'): ({'sdh'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Removing single pathed devices sdh {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b56c74-79a8-48f5-b7d4-df2467c48844]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2be149e-a6a4-43eb-a2b6-d8419b476d88) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c06f18-663a-42a7-b114-5994e6f7f3dc]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Flushing IO for device /dev/sdh {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff6b77-64c7-475d-b671-40b4d4ff0cce]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:b4:46,bridge_name='br-int',has_traffic_filtering=True,id=1bf41897-28d2-4330-9306-804c943a8411,network=Network(2fd9399b-b8f9-4756-80c7-dfae9c8e6edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf41897-28')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:7d:13,bridge_name='br-int',has_traffic_filtering=True,id=7c4de563-daf8-46aa-9b5b-23c9e24bcee2,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c4de563-da') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:7d:13,bridge_name='br-int',has_traffic_filtering=True,id=7c4de563-daf8-46aa-9b5b-23c9e24bcee2,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c4de563-da') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c4de563-da, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e5eeb1-35be-4841-b0a1-e2a29f57ef8e]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] SCSI volumes sdh have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[32931cec-b0d2-4a88-94b6-300f401cac1a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5da28ea7-fa83-4cc4-aec9-19a991d9b831) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:7d:13,bridge_name='br-int',has_traffic_filtering=True,id=7c4de563-daf8-46aa-9b5b-23c9e24bcee2,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c4de563-da')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8c:e5,bridge_name='br-int',has_traffic_filtering=True,id=f51a05ea-ef40-44f9-a969-6e9e420590bb,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf51a05ea-ef') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8c:e5,bridge_name='br-int',has_traffic_filtering=True,id=f51a05ea-ef40-44f9-a969-6e9e420590bb,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf51a05ea-ef') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf51a05ea-ef, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[74116cd1-8215-45c1-bd6b-3558ffe20fbb]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260]
Oct 20 16:24:50 user nova-compute[74131]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fbb17eb-21fa-419d-a221-ec6dd1bf472b) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196a2605-accd-4a03-9534-4de4793e2192 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e8215-befd-4149-b77b-230774c75c41]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== disconnect_volume: return (407ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdmNWEpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8c:e5,bridge_name='br-int',has_traffic_filtering=True,id=f51a05ea-ef40-44f9-a969-6e9e420590bb,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf51a05ea-ef')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b5:67,bridge_name='br-int',has_traffic_filtering=True,id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf300e70d-b3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b5:67,bridge_name='br-int',has_traffic_filtering=True,id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf300e70d-b3') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4271a869-02e5-448a-9c70-6242f775855a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]: iSNS:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]: STATIC:
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:50 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:50 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf300e70d-b3, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4775f580-54c0-4281-963e-8f07a0fe8009]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Acquiring lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] No waiting events found dispatching network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received unexpected event network-vif-plugged-c1f7bff5-067d-4e94-9703-b3a03102c6bb for instance with vm_state active and task_state deleting.
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-unplugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-f300e70d-b38f-4f63-be92-3ec0c30ee8dc for instance with vm_state active and task_state deleting.
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-unplugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING nova.compute.manager [req-130a9265-2ff2-415f-ba87-f74723ab4bb0 req-664acb45-3b84-4016-935d-7ae4febb6706 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 for instance with vm_state active and task_state deleting.
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a0525f2-970d-4051-a07b-b0c8cba7c8e0) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[10312cf4-7b6f-4140-be63-427182b72c94]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a877bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b'): ({'sdf'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Removing single pathed devices sdf {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b5:67,bridge_name='br-int',has_traffic_filtering=True,id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf300e70d-b3')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:c8,bridge_name='br-int',has_traffic_filtering=True,id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a14a4e6-3a') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:c8,bridge_name='br-int',has_traffic_filtering=True,id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a14a4e6-3a') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e7c7b0-5410-4727-9dac-088d0d43bb44]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a14a4e6-3a, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fd6790-c4b3-4b46-bdd5-30ba49c9f674]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Flushing IO for device /dev/sdf {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b387d9ee-574c-4bf9-ae52-aabd50f1cff2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efc818a4-db2f-4533-99a2-c3ed93c10a55) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:c8,bridge_name='br-int',has_traffic_filtering=True,id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020,network=Network(87a85044-7f0a-4622-a601-fa860e5dc41f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a14a4e6-3a')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:7c,bridge_name='br-int',has_traffic_filtering=True,id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c9b25b-7d') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:7c,bridge_name='br-int',has_traffic_filtering=True,id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c9b25b-7d') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c9b25b-7d, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bafefc7-5aec-49f0-b185-d48ad7a6d1fa) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6d8dc-5734-4760-a52b-53b50754fd3d]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:9d:7c,bridge_name='br-int',has_traffic_filtering=True,id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c9b25b-7d')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T16:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1703448913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1703448913',id=10,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8nLVhOy1X9paBRMCrv7LBYCRsh+U4PrkaQvhCCwl4SEX6dcySFUDijkNBvpRmvagx93ew8lHEWR6McvTDblHWWUyLtix9n4mlBQwUurHGcfQhwGEBvbNhwrCsOV0QqTA==',key_name='tempest-keypair-1024103814',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54ffe9b3287344cb979587e0f18bc99d',ramdisk_id='',reservation_id='r-om75dguj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-183686554',owner_user_name='tempest-TaggedBootDevicesTest-183686554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9802f39e1c04548b788f94302d2406f',uuid=3308d7fc-97c0-4491-89da-b2c764637509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converting VIF {"id": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "address": "fa:16:3e:81:7f:3e", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped445149-84", "ovs_interfaceid": "ed445149-84d5-4acc-9ce3-d0d0a264cfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:3e,bridge_name='br-int',has_traffic_filtering=True,id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped445149-84') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:3e,bridge_name='br-int',has_traffic_filtering=True,id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped445149-84') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped445149-84, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfda50ea-e510-469d-8a67-afcca309ec71) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:24:50 user nova-compute[74131]: INFO os_vif [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:3e,bridge_name='br-int',has_traffic_filtering=True,id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3,network=Network(b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped445149-84')
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5c2ea-5d2c-4de8-9d23-14706ee2ca2a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIhlrQxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea34b1-1262-47d6-b31d-4170ab8ae6c4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260]
Oct 20 16:24:50 user nova-compute[74131]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd32cf37-0b04-47c4-8220-5be5ba52521b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[660dcc2f-5aa9-4f7e-9174-101098c8a058]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== disconnect_volume: return (437ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.141s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkXVzyjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-unplugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-7c4de563-daf8-46aa-9b5b-23c9e24bcee2 for instance with vm_state active and task_state deleting.
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-unplugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-f51a05ea-ef40-44f9-a969-6e9e420590bb for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-f51a05ea-ef40-44f9-a969-6e9e420590bb for instance with vm_state active and task_state deleting.
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-unplugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-unplugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:50 user nova-compute[74131]: WARNING nova.compute.manager [req-54a8ab03-70ba-42c2-a350-b881c13b411a req-4e74d7b7-5ec9-43e5-b897-db5513f7c963 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 for instance with vm_state active and task_state deleting.
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0801fe6a-34bf-449a-9fc1-ff21494b8395]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]: iSNS:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]: STATIC:
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734
Oct 20 16:24:50 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:50 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:50 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:50 user nova-compute[74131]: No targets found.
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:50 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:50 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49ce7c-6c0a-41b4-bf95-12405817a4c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[043c68d4-3bc9-4163-afaa-56be560d4997]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:50 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e805f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734'): ({'sdj'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Removing single pathed devices sdj {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01fb410-1025-4a17-b3fe-32dbea4bb24f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b41801-c94a-4d04-9bdc-999d52ccd400]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Flushing IO for device /dev/sdj {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad49c623-402e-446b-a921-11e86933e0a4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.044s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[746f63b7-3b9d-44c5-a2e0-29412b102746]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] SCSI volumes sdj have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdc41aa-42a9-43a5-be01-8449ee92cc2b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c440385-5694-404f-9faf-cbe079d11755]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260]
Oct 20 16:24:51 user nova-compute[74131]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16bb4d5e-217e-44db-a958-95bc2287c734 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac635e7-e030-4e1c-aba3-e180ee47609f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== disconnect_volume: return (490ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.345s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBCatUTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:51 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcca59e-0baf-4a3a-9599-3b6143eb87eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]: iSNS:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]: STATIC:
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:51 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:51 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfda0416-2197-40f8-8820-25e27a7a5deb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c37b8f0-0531-4216-810c-8e331111aeda]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c866a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29'): ({'sdi'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Removing single pathed devices sdi {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[021bdbfc-a5cc-4e7d-837d-7b3d9e2e8d8b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[163de687-c4ad-4695-a5a1-3541e720ce17]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Flushing IO for device /dev/sdi {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170082d-c1b0-4886-a74c-07b219cde297]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8853af-c8bb-44e9-b553-882fdf4a3fb3]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] SCSI volumes sdi have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b9561-4433-45ad-9ec1-4bd88ca72d55]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-8fb7dc41-5327-4be2-a4b8-b2d5830313a7 req-4096e1b2-5469-4a96-8cf6-76b78600471a service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8fb7dc41-5327-4be2-a4b8-b2d5830313a7 req-4096e1b2-5469-4a96-8cf6-76b78600471a service nova] Acquiring lock "3308d7fc-97c0-4491-89da-b2c764637509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8fb7dc41-5327-4be2-a4b8-b2d5830313a7 req-4096e1b2-5469-4a96-8cf6-76b78600471a service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8fb7dc41-5327-4be2-a4b8-b2d5830313a7 req-4096e1b2-5469-4a96-8cf6-76b78600471a service nova] Lock "3308d7fc-97c0-4491-89da-b2c764637509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-8fb7dc41-5327-4be2-a4b8-b2d5830313a7 req-4096e1b2-5469-4a96-8cf6-76b78600471a service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] No waiting events found dispatching network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:24:51 user nova-compute[74131]: WARNING nova.compute.manager [req-8fb7dc41-5327-4be2-a4b8-b2d5830313a7 req-4096e1b2-5469-4a96-8cf6-76b78600471a service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received unexpected event network-vif-plugged-d6c9b25b-7ddc-447e-9571-c1a727de3f8e for instance with vm_state active and task_state deleting.
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b973db-d536-4519-852a-99a96e09bb72]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260]
Oct 20 16:24:51 user nova-compute[74131]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d794f8fe-7f1c-4789-9e40-fed18c0a9e29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ea5694-1983-4474-a09f-12074d10510a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] <== disconnect_volume: return (671ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Deleting instance files /opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca_del
Oct 20 16:24:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Deletion of /opt/stack/data/nova/instances/a6903514-5d6a-4954-bb2d-a5da5d5624ca_del complete
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.329s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d5e9c-4fe7-4546-be90-e0437386fa70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]: iSNS:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]: STATIC:
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:51 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:51 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe22993-15a6-4cf0-865e-66cb6b4042ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: INFO nova.compute.manager [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Took 5.66 seconds to destroy the instance on the hypervisor.
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa6cd6d-d548-4ec0-87a2-299cf11ac51e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:51 user nova-compute[74131]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad (non-flash)
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e805f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad'): ({'sdg'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Removing single pathed devices sdg {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85bf37-b7e2-4c26-ba4d-27168f50b2af]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f52553c-b98b-4b56-b541-ee081f464cd0]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Flushing IO for device /dev/sdg {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[03565a35-add2-474a-a187-808631c5f557]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[091a833d-92d4-48ae-8079-a84286c0d400]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] SCSI volumes sdg have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d88c30-0772-43b7-bda5-6f4b44f2d138]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[183b8bb2-72d0-4266-b0b8-3360ec668719]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260]
Oct 20 16:24:51 user nova-compute[74131]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217944a7-0357-4339-84be-09d598f35aad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a691e6d6-43ab-40b5-b61e-50977b9f9e91]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== disconnect_volume: return (671ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBdpbPwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:51 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[518c3d4a-7e0b-4e16-b45c-5f6e5310b40b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]: iSNS:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]: STATIC:
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:51 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:51 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:51 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:51 user nova-compute[74131]: No targets found.
Oct 20 16:24:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:51 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:51 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1b4486-5f86-4c15-ad2f-cf34493da53a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce27bed-233d-4680-8824-d241cb7dc463]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87a8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:52 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6f5e776-329d-4e3c-a18c-ca4a01789def is timed out.
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Successfully detached device vdb from instance a6f5e776-329d-4e3c-a18c-ca4a01789def from the live domain config.
Oct 20 16:24:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLJxhMYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '119f7808-e6ad-43ab-abca-8c214cc87240'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:24:52 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4482e7-5668-455a-a264-4bd77b0b34c2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b49546d-4100-490b-8133-2cc048ed41ca]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[db03b1b9-74d2-4e3f-9bda-1ef7f717efbb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3a3284-2b28-4ee5-b689-21bf128273e5]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9803ec2-2e7f-4080-ae41-fc9b06aa06a7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0822404c-8a8d-4ec0-ac77-f583115a0427]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260]
Oct 20 16:24:52 user nova-compute[74131]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51957990-4701-49da-825a-08348c95dfd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98d78bd-ea69-44da-9548-b57265b3bbb8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] <== disconnect_volume: return (390ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Deleting instance files /opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509_del
Oct 20 16:24:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Deletion of /opt/stack/data/nova/instances/3308d7fc-97c0-4491-89da-b2c764637509_del complete
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.294s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea83ca05-94e4-4406-8dc2-3c8a762ff0b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:24:52 user nova-compute[74131]: No targets found.
Oct 20 16:24:52 user nova-compute[74131]: iSNS:
Oct 20 16:24:52 user nova-compute[74131]: No targets found.
Oct 20 16:24:52 user nova-compute[74131]: STATIC:
Oct 20 16:24:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:24:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240
Oct 20 16:24:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:24:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:24:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:24:52 user nova-compute[74131]: FIRMWARE:
Oct 20 16:24:52 user nova-compute[74131]: No targets found.
Oct 20 16:24:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:24:52 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:24:52 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[da68017c-1019-4e5e-8d50-d3c13f2e8fcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e576a1c-0673-4d61-afcf-8f8b8ca64521]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:24:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c81f2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240'): ({'sdk'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Removing single pathed devices sdk {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: INFO nova.compute.manager [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Took 4.41 seconds to destroy the instance on the hypervisor.
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9cce5-6e4f-40fd-8f1b-341d413f2a0f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7604ee-519c-4974-8e2f-9d8fc85a4c6e]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Flushing IO for device /dev/sdk {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee3fcf4-c6d6-4a9f-9e2f-cbb66fe10576]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aca8a4c-48fc-4697-8385-30e32810beef]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] SCSI volumes sdk have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f74200-56c3-459b-b787-f0afd4168f69]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27757ef-9b42-49de-b59b-08aca3ce693e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260]
Oct 20 16:24:52 user nova-compute[74131]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240, portal: 172.16.0.220,3260] successful.
Oct 20 16:24:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119f7808-e6ad-43ab-abca-8c214cc87240 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a26b1db-4dfb-40c6-b767-278b1fff91a2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] <== disconnect_volume: return (705ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:24:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:24:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-0ee1bc79-f01e-42c0-9fdf-8a9f83bff930 req-e5f659c8-d9b3-4f59-96a8-dcbc4e141c8d service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-deleted-a156a317-1011-417d-b4da-199d79eca471 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:53 user nova-compute[74131]: INFO nova.compute.manager [req-0ee1bc79-f01e-42c0-9fdf-8a9f83bff930 req-e5f659c8-d9b3-4f59-96a8-dcbc4e141c8d service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Neutron deleted interface a156a317-1011-417d-b4da-199d79eca471; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:53 user nova-compute[74131]: DEBUG nova.network.neutron [req-0ee1bc79-f01e-42c0-9fdf-8a9f83bff930 req-e5f659c8-d9b3-4f59-96a8-dcbc4e141c8d service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "address": "fa:16:3e:6b:42:cf", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa567a97b-c4", "ovs_interfaceid": "a567a97b-c472-4481-97db-7d7a4ef92ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-0ee1bc79-f01e-42c0-9fdf-8a9f83bff930 req-e5f659c8-d9b3-4f59-96a8-dcbc4e141c8d service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Detach interface failed, port_id=a156a317-1011-417d-b4da-199d79eca471, reason: Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:54 user nova-compute[74131]: DEBUG nova.objects.instance [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lazy-loading 'flavor' on Instance uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:24:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-78faa1ae-bcc0-4b9d-8983-c5eb82e15d35 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.820s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-722fbca8-13ce-49fc-b384-3854c076a876 req-7f400283-d6b9-41a6-a634-42f9696765ce service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-deleted-ed445149-84d5-4acc-9ce3-d0d0a264cfc3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:54 user nova-compute[74131]: INFO nova.compute.manager [req-722fbca8-13ce-49fc-b384-3854c076a876 req-7f400283-d6b9-41a6-a634-42f9696765ce service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Neutron deleted interface ed445149-84d5-4acc-9ce3-d0d0a264cfc3; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-722fbca8-13ce-49fc-b384-3854c076a876 req-7f400283-d6b9-41a6-a634-42f9696765ce service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "1bf41897-28d2-4330-9306-804c943a8411", "address": "fa:16:3e:64:b4:46", "network": {"id": "2fd9399b-b8f9-4756-80c7-dfae9c8e6edb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-159506559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf41897-28", "ovs_interfaceid": "1bf41897-28d2-4330-9306-804c943a8411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-722fbca8-13ce-49fc-b384-3854c076a876 req-7f400283-d6b9-41a6-a634-42f9696765ce service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Detach interface failed, port_id=ed445149-84d5-4acc-9ce3-d0d0a264cfc3, reason: Instance 3308d7fc-97c0-4491-89da-b2c764637509 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-deleted-a567a97b-c472-4481-97db-7d7a4ef92ec1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:55 user nova-compute[74131]: INFO nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Neutron deleted interface a567a97b-c472-4481-97db-7d7a4ef92ec1; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "99757533-e66b-4bc8-97d0-7d48f34782bf", "address": "fa:16:3e:28:e7:13", "network": {"id": "f76591c7-6b7b-4f84-b36a-73c78453670a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-287074456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99757533-e6", "ovs_interfaceid": "99757533-e66b-4bc8-97d0-7d48f34782bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Detach interface failed, port_id=a567a97b-c472-4481-97db-7d7a4ef92ec1, reason: Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-deleted-99757533-e66b-4bc8-97d0-7d48f34782bf {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:55 user nova-compute[74131]: INFO nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Neutron deleted interface 99757533-e66b-4bc8-97d0-7d48f34782bf; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a146d40a-536f-4bec-8a48-d162c51c818e", "address": "fa:16:3e:01:a7:71", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa146d40a-53", "ovs_interfaceid": "a146d40a-536f-4bec-8a48-d162c51c818e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Detach interface failed, port_id=99757533-e66b-4bc8-97d0-7d48f34782bf, reason: Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-deleted-a146d40a-536f-4bec-8a48-d162c51c818e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:55 user nova-compute[74131]: INFO nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Neutron deleted interface a146d40a-536f-4bec-8a48-d162c51c818e; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [{"id": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "address": "fa:16:3e:04:07:87", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c568f79-cd", "ovs_interfaceid": "5c568f79-cd10-49f5-83a9-b3c375a11c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c275f1-5b09-4cf8-8590-8971595a828c", "address": "fa:16:3e:98:b2:98", "network": {"id": "8f60e819-8275-4d69-aa45-36c9d91b7398", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208069396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c275f1-5b", "ovs_interfaceid": "a5c275f1-5b09-4cf8-8590-8971595a828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "address": "fa:16:3e:17:a8:15", "network": {"id": "3bb0fe81-6261-4641-a527-c4d73bf7197c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1261179041", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7731c7dd721a4ffca10b9a305aedc1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f7bff5-06", "ovs_interfaceid": "c1f7bff5-067d-4e94-9703-b3a03102c6bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ba4b9b35-713f-4cbc-b9fd-265d1621f878 req-3d77bbac-23ec-4124-9602-e952b00eaeda service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Detach interface failed, port_id=a146d40a-536f-4bec-8a48-d162c51c818e, reason: Instance a6903514-5d6a-4954-bb2d-a5da5d5624ca could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:55 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:56 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Took 4.38 seconds to deallocate network for instance.
Oct 20 16:24:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:56 user nova-compute[74131]: INFO nova.compute.manager [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Detaching volume dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:24:56 user nova-compute[74131]: INFO nova.virt.block_device [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Attempting to driver detach volume dcd49c92-69bf-4992-a70f-469c293bc533 from mountpoint /dev/vdb
Oct 20 16:24:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Attempting to detach device vdb from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:24:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:24:56 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:56 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:24:56 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:24:56 user nova-compute[74131]:   <serial>dcd49c92-69bf-4992-a70f-469c293bc533</serial>
Oct 20 16:24:56 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:24:56 user nova-compute[74131]: </disk>
Oct 20 16:24:56 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:24:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Successfully detached device vdb from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the persistent domain config.
Oct 20 16:24:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:24:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:24:56 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:24:56 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:24:56 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:24:56 user nova-compute[74131]:   <serial>dcd49c92-69bf-4992-a70f-469c293bc533</serial>
Oct 20 16:24:56 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:24:56 user nova-compute[74131]: </disk>
Oct 20 16:24:56 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:24:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-deleted-1bf41897-28d2-4330-9306-804c943a8411 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:56 user nova-compute[74131]: INFO nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Neutron deleted interface 1bf41897-28d2-4330-9306-804c943a8411; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "address": "fa:16:3e:d9:9d:7c", "network": {"id": "b5c4ede3-ac42-4df6-ab4b-b7c50fa86d39", "bridge": "br-int", "label": "tempest-device-tagging-net2-1683902897", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c9b25b-7d", "ovs_interfaceid": "d6c9b25b-7ddc-447e-9571-c1a727de3f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Detach interface failed, port_id=1bf41897-28d2-4330-9306-804c943a8411, reason: Instance 3308d7fc-97c0-4491-89da-b2c764637509 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-deleted-d6c9b25b-7ddc-447e-9571-c1a727de3f8e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:57 user nova-compute[74131]: INFO nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Neutron deleted interface d6c9b25b-7ddc-447e-9571-c1a727de3f8e; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "address": "fa:16:3e:45:05:c8", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a14a4e6-3a", "ovs_interfaceid": "5a14a4e6-3aa5-43cb-9559-0f2bff7b2020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Detach interface failed, port_id=d6c9b25b-7ddc-447e-9571-c1a727de3f8e, reason: Instance 3308d7fc-97c0-4491-89da-b2c764637509 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-deleted-5a14a4e6-3aa5-43cb-9559-0f2bff7b2020 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:57 user nova-compute[74131]: INFO nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Neutron deleted interface 5a14a4e6-3aa5-43cb-9559-0f2bff7b2020; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "address": "fa:16:3e:c8:b5:67", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf300e70d-b3", "ovs_interfaceid": "f300e70d-b38f-4f63-be92-3ec0c30ee8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:57 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Took 4.79 seconds to deallocate network for instance.
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3679a52-f64d-4334-bdd2-b916fc8b797d req-d21cbc40-e38a-4ae6-b5a6-24c7086b9d21 service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Detach interface failed, port_id=5a14a4e6-3aa5-43cb-9559-0f2bff7b2020, reason: Instance 3308d7fc-97c0-4491-89da-b2c764637509 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-0cae4913-f0f2-4808-af82-1865e5b58701 req-fa1c0d67-7557-449d-b2ec-2ed61fedf718 service nova] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Received event network-vif-deleted-c1f7bff5-067d-4e94-9703-b3a03102c6bb {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-8d235e6a-d28e-43ef-a5fd-6795bdbe5dfe req-4eeafa06-6e51-4396-a4a2-57d2223b643b service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Received event network-vif-deleted-f300e70d-b38f-4f63-be92-3ec0c30ee8dc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:24:59 user nova-compute[74131]: INFO nova.compute.manager [req-8d235e6a-d28e-43ef-a5fd-6795bdbe5dfe req-4eeafa06-6e51-4396-a4a2-57d2223b643b service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Neutron deleted interface f300e70d-b38f-4f63-be92-3ec0c30ee8dc; detaching it from the instance and deleting it from the info cache
Oct 20 16:24:59 user nova-compute[74131]: DEBUG nova.network.neutron [req-8d235e6a-d28e-43ef-a5fd-6795bdbe5dfe req-4eeafa06-6e51-4396-a4a2-57d2223b643b service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Updating instance_info_cache with network_info: [{"id": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "address": "fa:16:3e:66:7d:13", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c4de563-da", "ovs_interfaceid": "7c4de563-daf8-46aa-9b5b-23c9e24bcee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "address": "fa:16:3e:d4:8c:e5", "network": {"id": "87a85044-7f0a-4622-a601-fa860e5dc41f", "bridge": "br-int", "label": "tempest-device-tagging-net1-67378450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54ffe9b3287344cb979587e0f18bc99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a05ea-ef", "ovs_interfaceid": "f51a05ea-ef40-44f9-a969-6e9e420590bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:24:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-8d235e6a-d28e-43ef-a5fd-6795bdbe5dfe req-4eeafa06-6e51-4396-a4a2-57d2223b643b service nova] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Detach interface failed, port_id=f300e70d-b38f-4f63-be92-3ec0c30ee8dc, reason: Instance 3308d7fc-97c0-4491-89da-b2c764637509 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:24:59 user nova-compute[74131]: INFO nova.compute.manager [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] [instance: a6903514-5d6a-4954-bb2d-a5da5d5624ca] Took 3.42 seconds to detach 3 volumes for instance.
Oct 20 16:24:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:24:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:24:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:24:59 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:24:59 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:24:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:24:59 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Deleted allocations for instance a6903514-5d6a-4954-bb2d-a5da5d5624ca
Oct 20 16:24:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7de148b-aba6-4a05-9459-066a82df6a76 tempest-TaggedBootDevicesTest_v242-1757416359 tempest-TaggedBootDevicesTest_v242-1757416359-project-member] Lock "a6903514-5d6a-4954-bb2d-a5da5d5624ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.992s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:00 user nova-compute[74131]: INFO nova.compute.manager [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] [instance: 3308d7fc-97c0-4491-89da-b2c764637509] Took 3.14 seconds to detach 3 volumes for instance.
Oct 20 16:25:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:00 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:25:00 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:25:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:00 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Deleted allocations for instance 3308d7fc-97c0-4491-89da-b2c764637509
Oct 20 16:25:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-143abe48-2a0a-40b6-a332-1724c84cbf52 tempest-TaggedBootDevicesTest-183686554 tempest-TaggedBootDevicesTest-183686554-project-member] Lock "3308d7fc-97c0-4491-89da-b2c764637509" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.790s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:25:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:25:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:25:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:25:15 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating instance_info_cache with network_info: [{"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3e22a492-a812-415d-92c1-3cc51b842cc0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:25:17 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d is timed out.
Oct 20 16:25:17 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Successfully detached device vdb from instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d from the live domain config.
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytURqMmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:25:17 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0475f46a-ebc3-4daa-ac19-b4599dd9580b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:25:17 user nova-compute[74131]: No targets found.
Oct 20 16:25:17 user nova-compute[74131]: iSNS:
Oct 20 16:25:17 user nova-compute[74131]: No targets found.
Oct 20 16:25:17 user nova-compute[74131]: STATIC:
Oct 20 16:25:17 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533
Oct 20 16:25:17 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:25:17 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:25:17 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:25:17 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:25:17 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:25:17 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:25:17 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:25:17 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:25:17 user nova-compute[74131]: FIRMWARE:
Oct 20 16:25:17 user nova-compute[74131]: No targets found.
Oct 20 16:25:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:25:17 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:25:17 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba05bc0-68a9-409b-a6e9-de9f64ba8d9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[886ed2d4-bde1-4520-946f-5e61b6578caa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:25:17 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:25:17 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:25:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 (non-flash)
Oct 20 16:25:17 user nova-compute[74131]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:25:17 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:25:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a875ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533'): ({'sde'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Removing single pathed devices sde {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf6d2e-30d9-4d51-8ead-376259c11527]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3db046e-1c28-4b08-b4b0-5c21d30c1c59]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Flushing IO for device /dev/sde {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba57be60-0f05-4058-bba8-e40cf9b6ece2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5b4db2-ba8f-4100-b9db-d2d099bee7d9]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dc69a7-b4b8-45d7-bb40-eaee0b8061b8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e82abc0-55b7-4ff4-bbfc-995066aff9be]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260]
Oct 20 16:25:17 user nova-compute[74131]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533, portal: 172.16.0.220,3260] successful.
Oct 20 16:25:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcd49c92-69bf-4992-a70f-469c293bc533 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb09fd6-11d3-4436-9b90-66180d9874cc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] <== disconnect_volume: return (426ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'flavor' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0299a29a-ad34-40ea-bef1-d2cdc94a92d3 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.532s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:25:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdm (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:25:19 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:19 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:19 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8125MB free_disk=25.623401641845703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:25:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3e22a492-a812-415d-92c1-3cc51b842cc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a6f5e776-329d-4e3c-a18c-ca4a01789def actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d2f0a264-c008-4a8d-a043-e3d391371e03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.954s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:25:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:21 user nova-compute[74131]: INFO nova.compute.manager [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Detaching volume 387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:25:21 user nova-compute[74131]: INFO nova.virt.block_device [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Attempting to driver detach volume 387825ee-5645-4ed4-9f4a-0eec9182ec63 from mountpoint /dev/vdb
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Attempting to detach device vdb from instance 3e22a492-a812-415d-92c1-3cc51b842cc0 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:25:21 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:25:21 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:25:21 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:25:21 user nova-compute[74131]:   <serial>387825ee-5645-4ed4-9f4a-0eec9182ec63</serial>
Oct 20 16:25:21 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:25:21 user nova-compute[74131]: </disk>
Oct 20 16:25:21 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:25:21 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully detached device vdb from instance 3e22a492-a812-415d-92c1-3cc51b842cc0 from the persistent domain config.
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e22a492-a812-415d-92c1-3cc51b842cc0 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:25:21 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:25:21 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:25:21 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:25:21 user nova-compute[74131]:   <serial>387825ee-5645-4ed4-9f4a-0eec9182ec63</serial>
Oct 20 16:25:21 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:25:21 user nova-compute[74131]: </disk>
Oct 20 16:25:21 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "0c360989-4303-456b-af5d-bb341e654098" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:25:21 user nova-compute[74131]: INFO nova.compute.claims [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Claim successful on node user
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:21 user nova-compute[74131]: INFO nova.compute.manager [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Terminating instance
Oct 20 16:25:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:25:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:25:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Creating image(s)
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "/opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "/opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.policy [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '757415037269406cbc1dfe3de4465c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bc52c1d965465687699b8e0118300b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Instance destroyed successfully.
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lazy-loading 'resources' on Instance uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1490444509',display_name='tempest-TestVolumeSwap-server-1490444509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1490444509',id=5,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ0Dbgyd6beU9QjokskqLW++QqkggxyK+gUfd/3nbNJSbHCXitnZK0FSBWwVia8v2g8oYNjByAFfnLrIRVeEF93yObN7E8q8d1P672Rt7hos1oJiVuHCKIF7S13MIh7FQ==',key_name='tempest-keypair-1723633253',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d31fa4fbd88d4bf7b181c1857dcd37f5',ramdisk_id='',reservation_id='r-a2u7t0w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1520187436',owner_user_name='tempest-TestVolumeSwap-1520187436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca7fd49bd6b145b1a93885cf21e51a87',uuid=a6f5e776-329d-4e3c-a18c-ca4a01789def,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Converting VIF {"id": "08dbda12-aa82-450d-abd5-87e218a4bc78", "address": "fa:16:3e:ab:6d:2f", "network": {"id": "7966b52a-203b-474c-8214-b83f4baa4ba5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1786907160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d31fa4fbd88d4bf7b181c1857dcd37f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08dbda12-aa", "ovs_interfaceid": "08dbda12-aa82-450d-abd5-87e218a4bc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:6d:2f,bridge_name='br-int',has_traffic_filtering=True,id=08dbda12-aa82-450d-abd5-87e218a4bc78,network=Network(7966b52a-203b-474c-8214-b83f4baa4ba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08dbda12-aa') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG os_vif [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:6d:2f,bridge_name='br-int',has_traffic_filtering=True,id=08dbda12-aa82-450d-abd5-87e218a4bc78,network=Network(7966b52a-203b-474c-8214-b83f4baa4ba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08dbda12-aa') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08dbda12-aa, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.342s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeba35d2-d1fb-404a-88df-6825667689a8) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:23 user nova-compute[74131]: INFO os_vif [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:6d:2f,bridge_name='br-int',has_traffic_filtering=True,id=08dbda12-aa82-450d-abd5-87e218a4bc78,network=Network(7966b52a-203b-474c-8214-b83f4baa4ba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08dbda12-aa')
Oct 20 16:25:23 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Deleting instance files /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def_del
Oct 20 16:25:23 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Deletion of /opt/stack/data/nova/instances/a6f5e776-329d-4e3c-a18c-ca4a01789def_del complete
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-9305c8a0-14f7-41ac-9401-a14f6ec8165a req-5020f1de-6108-4ad5-8675-0485bdf2c44b service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-vif-unplugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9305c8a0-14f7-41ac-9401-a14f6ec8165a req-5020f1de-6108-4ad5-8675-0485bdf2c44b service nova] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9305c8a0-14f7-41ac-9401-a14f6ec8165a req-5020f1de-6108-4ad5-8675-0485bdf2c44b service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9305c8a0-14f7-41ac-9401-a14f6ec8165a req-5020f1de-6108-4ad5-8675-0485bdf2c44b service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-9305c8a0-14f7-41ac-9401-a14f6ec8165a req-5020f1de-6108-4ad5-8675-0485bdf2c44b service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] No waiting events found dispatching network-vif-unplugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-9305c8a0-14f7-41ac-9401-a14f6ec8165a req-5020f1de-6108-4ad5-8675-0485bdf2c44b service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-vif-unplugged-08dbda12-aa82-450d-abd5-87e218a4bc78 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:25:23 user nova-compute[74131]: INFO nova.compute.manager [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.253s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk 1073741824" returned: 0 in 0.052s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.245s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:25:23 user nova-compute[74131]: WARNING nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] While synchronizing instance power states, found 6 instances in the database and 4 instances on the hypervisor.
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid a6f5e776-329d-4e3c-a18c-ca4a01789def {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid d2f0a264-c008-4a8d-a043-e3d391371e03 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 151335d8-e828-425b-8422-ba047749b204 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 0c360989-4303-456b-af5d-bb341e654098 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "151335d8-e828-425b-8422-ba047749b204" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "151335d8-e828-425b-8422-ba047749b204" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Cannot resize image /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Ensure instance console log exists: /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.261s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.322s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "151335d8-e828-425b-8422-ba047749b204" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.366s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Successfully created port: cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-d5d2a3c4-08ae-4849-a27b-52633acb8d18 req-6b24317b-f2f1-4173-9ba3-3b51ec3385aa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-vif-deleted-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:24 user nova-compute[74131]: INFO nova.compute.manager [req-d5d2a3c4-08ae-4849-a27b-52633acb8d18 req-6b24317b-f2f1-4173-9ba3-3b51ec3385aa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Neutron deleted interface 08dbda12-aa82-450d-abd5-87e218a4bc78; detaching it from the instance and deleting it from the info cache
Oct 20 16:25:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-d5d2a3c4-08ae-4849-a27b-52633acb8d18 req-6b24317b-f2f1-4173-9ba3-3b51ec3385aa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:24 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Took 1.53 seconds to deallocate network for instance.
Oct 20 16:25:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-d5d2a3c4-08ae-4849-a27b-52633acb8d18 req-6b24317b-f2f1-4173-9ba3-3b51ec3385aa service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Detach interface failed, port_id=08dbda12-aa82-450d-abd5-87e218a4bc78, reason: Instance a6f5e776-329d-4e3c-a18c-ca4a01789def could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:25 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Deleted allocations for instance a6f5e776-329d-4e3c-a18c-ca4a01789def
Oct 20 16:25:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-7ad64e12-ebb3-4296-9b86-0d03f26c7cd2 req-6963a1b1-14f0-4ab6-84d5-6003b6ad2eb0 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received event network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7ad64e12-ebb3-4296-9b86-0d03f26c7cd2 req-6963a1b1-14f0-4ab6-84d5-6003b6ad2eb0 service nova] Acquiring lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7ad64e12-ebb3-4296-9b86-0d03f26c7cd2 req-6963a1b1-14f0-4ab6-84d5-6003b6ad2eb0 service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7ad64e12-ebb3-4296-9b86-0d03f26c7cd2 req-6963a1b1-14f0-4ab6-84d5-6003b6ad2eb0 service nova] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-7ad64e12-ebb3-4296-9b86-0d03f26c7cd2 req-6963a1b1-14f0-4ab6-84d5-6003b6ad2eb0 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] No waiting events found dispatching network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:25 user nova-compute[74131]: WARNING nova.compute.manager [req-7ad64e12-ebb3-4296-9b86-0d03f26c7cd2 req-6963a1b1-14f0-4ab6-84d5-6003b6ad2eb0 service nova] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] Received unexpected event network-vif-plugged-08dbda12-aa82-450d-abd5-87e218a4bc78 for instance with vm_state deleted and task_state None.
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31099379-3cfd-4ac6-8ce2-c34e8b5662c8 tempest-TestVolumeSwap-1520187436 tempest-TestVolumeSwap-1520187436-project-member] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.368s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.572s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:25 user nova-compute[74131]: INFO nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a6f5e776-329d-4e3c-a18c-ca4a01789def] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a6f5e776-329d-4e3c-a18c-ca4a01789def" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Successfully updated port: cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "refresh_cache-0c360989-4303-456b-af5d-bb341e654098" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquired lock "refresh_cache-0c360989-4303-456b-af5d-bb341e654098" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:25:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Updating instance_info_cache with network_info: [{"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Releasing lock "refresh_cache-0c360989-4303-456b-af5d-bb341e654098" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Instance network_info: |[{"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Start _get_guest_xml network_info=[{"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:25:26 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:26 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-472323587',display_name='tempest-ServersNegativeTestJSON-server-472323587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-472323587',id=14,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5bc52c1d965465687699b8e0118300b',ramdisk_id='',reservation_id='r-9vnlqrzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-270953747',owner_user_name='tempest-ServersNegativeTestJSON-270953747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:25:22Z,user_data=None,user_id='757415037269406cbc1dfe3de4465c53',uuid=0c360989-4303-456b-af5d-bb341e654098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converting VIF {"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:64:42,bridge_name='br-int',has_traffic_filtering=True,id=cc90be11-bf51-4fdb-a1a8-96f13ee53544,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc90be11-bf') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c360989-4303-456b-af5d-bb341e654098 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:25:26 user nova-compute[74131]:   <uuid>0c360989-4303-456b-af5d-bb341e654098</uuid>
Oct 20 16:25:26 user nova-compute[74131]:   <name>instance-0000000e</name>
Oct 20 16:25:26 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:25:26 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:25:26 user nova-compute[74131]:   <metadata>
Oct 20 16:25:26 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:25:26 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:25:26 user nova-compute[74131]:       <nova:name>tempest-ServersNegativeTestJSON-server-472323587</nova:name>
Oct 20 16:25:26 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:25:26</nova:creationTime>
Oct 20 16:25:26 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:25:26 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:25:26 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:25:26 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:25:26 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:25:26 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:25:26 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:25:26 user nova-compute[74131]:       <nova:owner>
Oct 20 16:25:26 user nova-compute[74131]:         <nova:user uuid="757415037269406cbc1dfe3de4465c53">tempest-ServersNegativeTestJSON-270953747-project-member</nova:user>
Oct 20 16:25:26 user nova-compute[74131]:         <nova:project uuid="a5bc52c1d965465687699b8e0118300b">tempest-ServersNegativeTestJSON-270953747</nova:project>
Oct 20 16:25:26 user nova-compute[74131]:       </nova:owner>
Oct 20 16:25:26 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:25:26 user nova-compute[74131]:       <nova:ports>
Oct 20 16:25:26 user nova-compute[74131]:         <nova:port uuid="cc90be11-bf51-4fdb-a1a8-96f13ee53544">
Oct 20 16:25:26 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 16:25:26 user nova-compute[74131]:         </nova:port>
Oct 20 16:25:26 user nova-compute[74131]:       </nova:ports>
Oct 20 16:25:26 user nova-compute[74131]:     </nova:instance>
Oct 20 16:25:26 user nova-compute[74131]:   </metadata>
Oct 20 16:25:26 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:25:26 user nova-compute[74131]:     <system>
Oct 20 16:25:26 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:25:26 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:25:26 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:25:26 user nova-compute[74131]:       <entry name="serial">0c360989-4303-456b-af5d-bb341e654098</entry>
Oct 20 16:25:26 user nova-compute[74131]:       <entry name="uuid">0c360989-4303-456b-af5d-bb341e654098</entry>
Oct 20 16:25:26 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:25:26 user nova-compute[74131]:     </system>
Oct 20 16:25:26 user nova-compute[74131]:   </sysinfo>
Oct 20 16:25:26 user nova-compute[74131]:   <os>
Oct 20 16:25:26 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:25:26 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:25:26 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:25:26 user nova-compute[74131]:   </os>
Oct 20 16:25:26 user nova-compute[74131]:   <features>
Oct 20 16:25:26 user nova-compute[74131]:     <acpi/>
Oct 20 16:25:26 user nova-compute[74131]:     <apic/>
Oct 20 16:25:26 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:25:26 user nova-compute[74131]:   </features>
Oct 20 16:25:26 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:25:26 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:25:26 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:25:26 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:25:26 user nova-compute[74131]:   </clock>
Oct 20 16:25:26 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:25:26 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:25:26 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:25:26 user nova-compute[74131]:   </cpu>
Oct 20 16:25:26 user nova-compute[74131]:   <devices>
Oct 20 16:25:26 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:25:26 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:25:26 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk"/>
Oct 20 16:25:26 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:25:26 user nova-compute[74131]:     </disk>
Oct 20 16:25:26 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:25:26 user nova-compute[74131]:       <mac address="fa:16:3e:6c:64:42"/>
Oct 20 16:25:26 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:25:26 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:25:26 user nova-compute[74131]:       <target dev="tapcc90be11-bf"/>
Oct 20 16:25:26 user nova-compute[74131]:     </interface>
Oct 20 16:25:26 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:25:26 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/console.log" append="off"/>
Oct 20 16:25:26 user nova-compute[74131]:     </serial>
Oct 20 16:25:26 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:25:26 user nova-compute[74131]:     <video>
Oct 20 16:25:26 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:25:26 user nova-compute[74131]:     </video>
Oct 20 16:25:26 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:25:26 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:25:26 user nova-compute[74131]:     </rng>
Oct 20 16:25:26 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:25:26 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:25:26 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:25:26 user nova-compute[74131]:     </memballoon>
Oct 20 16:25:26 user nova-compute[74131]:   </devices>
Oct 20 16:25:26 user nova-compute[74131]: </domain>
Oct 20 16:25:26 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-472323587',display_name='tempest-ServersNegativeTestJSON-server-472323587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-472323587',id=14,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5bc52c1d965465687699b8e0118300b',ramdisk_id='',reservation_id='r-9vnlqrzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-270953747',owner_user_name='tempest-ServersNegativeTestJSON-270953747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:25:22Z,user_data=None,user_id='757415037269406cbc1dfe3de4465c53',uuid=0c360989-4303-456b-af5d-bb341e654098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converting VIF {"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:64:42,bridge_name='br-int',has_traffic_filtering=True,id=cc90be11-bf51-4fdb-a1a8-96f13ee53544,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc90be11-bf') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG os_vif [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:64:42,bridge_name='br-int',has_traffic_filtering=True,id=cc90be11-bf51-4fdb-a1a8-96f13ee53544,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc90be11-bf') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11a7b17b-1313-5725-ba40-63a6a009510a', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc90be11-bf, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc90be11-bf, col_values=(('qos', UUID('4aabf6dd-e595-4f7b-8ccf-28713a95615c')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc90be11-bf, col_values=(('external_ids', {'iface-id': 'cc90be11-bf51-4fdb-a1a8-96f13ee53544', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:64:42', 'vm-uuid': '0c360989-4303-456b-af5d-bb341e654098'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:26 user nova-compute[74131]: INFO os_vif [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:64:42,bridge_name='br-int',has_traffic_filtering=True,id=cc90be11-bf51-4fdb-a1a8-96f13ee53544,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc90be11-bf')
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:25:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] No VIF found with MAC fa:16:3e:6c:64:42, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:25:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received event network-changed-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Refreshing instance network info cache due to event network-changed-cc90be11-bf51-4fdb-a1a8-96f13ee53544. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:25:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] Acquiring lock "refresh_cache-0c360989-4303-456b-af5d-bb341e654098" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:25:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] Acquired lock "refresh_cache-0c360989-4303-456b-af5d-bb341e654098" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:25:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Refreshing network info cache for port cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Updated VIF entry in instance network info cache for port cc90be11-bf51-4fdb-a1a8-96f13ee53544. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Updating instance_info_cache with network_info: [{"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7f6e2d50-58f7-48e5-9c75-38fde660c0da req-344579a7-ae50-4fea-9db9-c0288849cda5 service nova] Releasing lock "refresh_cache-0c360989-4303-456b-af5d-bb341e654098" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-9798b7a7-2a30-47fc-8750-2ffe5341648d req-24370b88-1bec-4475-b300-54e33f3fb75b service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received event network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9798b7a7-2a30-47fc-8750-2ffe5341648d req-24370b88-1bec-4475-b300-54e33f3fb75b service nova] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9798b7a7-2a30-47fc-8750-2ffe5341648d req-24370b88-1bec-4475-b300-54e33f3fb75b service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9798b7a7-2a30-47fc-8750-2ffe5341648d req-24370b88-1bec-4475-b300-54e33f3fb75b service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-9798b7a7-2a30-47fc-8750-2ffe5341648d req-24370b88-1bec-4475-b300-54e33f3fb75b service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] No waiting events found dispatching network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:28 user nova-compute[74131]: WARNING nova.compute.manager [req-9798b7a7-2a30-47fc-8750-2ffe5341648d req-24370b88-1bec-4475-b300-54e33f3fb75b service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received unexpected event network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 for instance with vm_state building and task_state spawning.
Oct 20 16:25:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:25:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:29 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:25:29 user nova-compute[74131]: INFO nova.compute.claims [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Claim successful on node user
Oct 20 16:25:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:25:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.policy [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f6bff83a2e24a289333823acf911ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db8a4e064f445abd0a8555aaa18b88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:25:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Creating image(s)
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "/opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "/opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "/opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:25:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 0c360989-4303-456b-af5d-bb341e654098] Instance spawned successfully.
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:30 user nova-compute[74131]: INFO nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Took 8.25 seconds to spawn the instance on the hypervisor.
Oct 20 16:25:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.234s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk 1073741824" returned: 0 in 0.050s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-63272c71-67b2-4ef0-a64d-57e16759cf94 req-b4d2f2e7-1d80-4294-a857-9e708a507cb6 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received event network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63272c71-67b2-4ef0-a64d-57e16759cf94 req-b4d2f2e7-1d80-4294-a857-9e708a507cb6 service nova] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63272c71-67b2-4ef0-a64d-57e16759cf94 req-b4d2f2e7-1d80-4294-a857-9e708a507cb6 service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63272c71-67b2-4ef0-a64d-57e16759cf94 req-b4d2f2e7-1d80-4294-a857-9e708a507cb6 service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-63272c71-67b2-4ef0-a64d-57e16759cf94 req-b4d2f2e7-1d80-4294-a857-9e708a507cb6 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] No waiting events found dispatching network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:31 user nova-compute[74131]: WARNING nova.compute.manager [req-63272c71-67b2-4ef0-a64d-57e16759cf94 req-b4d2f2e7-1d80-4294-a857-9e708a507cb6 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received unexpected event network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 for instance with vm_state building and task_state spawning.
Oct 20 16:25:31 user nova-compute[74131]: INFO nova.compute.manager [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Took 9.37 seconds to build instance.
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4641aed9-7e80-4429-a8e2-630a91162406 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "0c360989-4303-456b-af5d-bb341e654098" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.569s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "0c360989-4303-456b-af5d-bb341e654098" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.351s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:31 user nova-compute[74131]: INFO nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 0c360989-4303-456b-af5d-bb341e654098] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "0c360989-4303-456b-af5d-bb341e654098" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.239s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Successfully created port: ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Cannot resize image /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Ensure instance console log exists: /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Successfully updated port: ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquired lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-changed-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Refreshing instance network info cache due to event network-changed-ed1b4ad7-52eb-432e-877f-4430254707c3. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] Acquiring lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Releasing lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Instance network_info: |[{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] Acquired lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Refreshing network info cache for port ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Start _get_guest_xml network_info=[{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:25:32 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:32 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1576117610',display_name='tempest-ServerActionsTestOtherA-server-1576117610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1576117610',id=15,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8wkd6e0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:25:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=46c22ead-b9e5-4f15-8a36-f62c56dd5977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:06:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed1b4ad7-52eb-432e-877f-4430254707c3,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1b4ad7-52') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.objects.instance [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'pci_devices' on Instance uuid 46c22ead-b9e5-4f15-8a36-f62c56dd5977 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:25:32 user nova-compute[74131]:   <uuid>46c22ead-b9e5-4f15-8a36-f62c56dd5977</uuid>
Oct 20 16:25:32 user nova-compute[74131]:   <name>instance-0000000f</name>
Oct 20 16:25:32 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:25:32 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:25:32 user nova-compute[74131]:   <metadata>
Oct 20 16:25:32 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:25:32 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:25:32 user nova-compute[74131]:       <nova:name>tempest-ServerActionsTestOtherA-server-1576117610</nova:name>
Oct 20 16:25:32 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:25:32</nova:creationTime>
Oct 20 16:25:32 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:25:32 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:25:32 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:25:32 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:25:32 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:25:32 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:25:32 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:25:32 user nova-compute[74131]:       <nova:owner>
Oct 20 16:25:32 user nova-compute[74131]:         <nova:user uuid="2f6bff83a2e24a289333823acf911ccd">tempest-ServerActionsTestOtherA-844175334-project-member</nova:user>
Oct 20 16:25:32 user nova-compute[74131]:         <nova:project uuid="69db8a4e064f445abd0a8555aaa18b88">tempest-ServerActionsTestOtherA-844175334</nova:project>
Oct 20 16:25:32 user nova-compute[74131]:       </nova:owner>
Oct 20 16:25:32 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:25:32 user nova-compute[74131]:       <nova:ports>
Oct 20 16:25:32 user nova-compute[74131]:         <nova:port uuid="ed1b4ad7-52eb-432e-877f-4430254707c3">
Oct 20 16:25:32 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:25:32 user nova-compute[74131]:         </nova:port>
Oct 20 16:25:32 user nova-compute[74131]:       </nova:ports>
Oct 20 16:25:32 user nova-compute[74131]:     </nova:instance>
Oct 20 16:25:32 user nova-compute[74131]:   </metadata>
Oct 20 16:25:32 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:25:32 user nova-compute[74131]:     <system>
Oct 20 16:25:32 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:25:32 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:25:32 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:25:32 user nova-compute[74131]:       <entry name="serial">46c22ead-b9e5-4f15-8a36-f62c56dd5977</entry>
Oct 20 16:25:32 user nova-compute[74131]:       <entry name="uuid">46c22ead-b9e5-4f15-8a36-f62c56dd5977</entry>
Oct 20 16:25:32 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:25:32 user nova-compute[74131]:     </system>
Oct 20 16:25:32 user nova-compute[74131]:   </sysinfo>
Oct 20 16:25:32 user nova-compute[74131]:   <os>
Oct 20 16:25:32 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:25:32 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:25:32 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:25:32 user nova-compute[74131]:   </os>
Oct 20 16:25:32 user nova-compute[74131]:   <features>
Oct 20 16:25:32 user nova-compute[74131]:     <acpi/>
Oct 20 16:25:32 user nova-compute[74131]:     <apic/>
Oct 20 16:25:32 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:25:32 user nova-compute[74131]:   </features>
Oct 20 16:25:32 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:25:32 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:25:32 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:25:32 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:25:32 user nova-compute[74131]:   </clock>
Oct 20 16:25:32 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:25:32 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:25:32 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:25:32 user nova-compute[74131]:   </cpu>
Oct 20 16:25:32 user nova-compute[74131]:   <devices>
Oct 20 16:25:32 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:25:32 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:25:32 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk"/>
Oct 20 16:25:32 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:25:32 user nova-compute[74131]:     </disk>
Oct 20 16:25:32 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:25:32 user nova-compute[74131]:       <mac address="fa:16:3e:e8:06:e9"/>
Oct 20 16:25:32 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:25:32 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:25:32 user nova-compute[74131]:       <target dev="taped1b4ad7-52"/>
Oct 20 16:25:32 user nova-compute[74131]:     </interface>
Oct 20 16:25:32 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:25:32 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/console.log" append="off"/>
Oct 20 16:25:32 user nova-compute[74131]:     </serial>
Oct 20 16:25:32 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:25:32 user nova-compute[74131]:     <video>
Oct 20 16:25:32 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:25:32 user nova-compute[74131]:     </video>
Oct 20 16:25:32 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:25:32 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:25:32 user nova-compute[74131]:     </rng>
Oct 20 16:25:32 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:25:32 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:25:32 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:25:32 user nova-compute[74131]:     </memballoon>
Oct 20 16:25:32 user nova-compute[74131]:   </devices>
Oct 20 16:25:32 user nova-compute[74131]: </domain>
Oct 20 16:25:32 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1576117610',display_name='tempest-ServerActionsTestOtherA-server-1576117610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1576117610',id=15,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8wkd6e0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:25:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=46c22ead-b9e5-4f15-8a36-f62c56dd5977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:06:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed1b4ad7-52eb-432e-877f-4430254707c3,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1b4ad7-52') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG os_vif [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:06:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed1b4ad7-52eb-432e-877f-4430254707c3,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1b4ad7-52') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b4ec376-04d9-57e8-b297-8d754d911e9c', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped1b4ad7-52, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped1b4ad7-52, col_values=(('qos', UUID('ab564161-2dc1-4c60-83d4-d06375e71093')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped1b4ad7-52, col_values=(('external_ids', {'iface-id': 'ed1b4ad7-52eb-432e-877f-4430254707c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:06:e9', 'vm-uuid': '46c22ead-b9e5-4f15-8a36-f62c56dd5977'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:32 user nova-compute[74131]: INFO os_vif [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:06:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed1b4ad7-52eb-432e-877f-4430254707c3,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1b4ad7-52')
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No VIF found with MAC fa:16:3e:e8:06:e9, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updated VIF entry in instance network info cache for port ed1b4ad7-52eb-432e-877f-4430254707c3. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-146287e6-1db6-497c-a4e6-c354ea679c7b req-486fed79-0cf1-4a54-abe2-4c250b03fd3b service nova] Releasing lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:25:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:25:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:33 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:25:33 user nova-compute[74131]: INFO nova.compute.claims [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Claim successful on node user
Oct 20 16:25:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-556703cc-aaf1-454a-b9fb-d2817f9a086c req-4e119779-31fb-4386-b79d-ca17f5d2fb46 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-556703cc-aaf1-454a-b9fb-d2817f9a086c req-4e119779-31fb-4386-b79d-ca17f5d2fb46 service nova] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-556703cc-aaf1-454a-b9fb-d2817f9a086c req-4e119779-31fb-4386-b79d-ca17f5d2fb46 service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-556703cc-aaf1-454a-b9fb-d2817f9a086c req-4e119779-31fb-4386-b79d-ca17f5d2fb46 service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-556703cc-aaf1-454a-b9fb-d2817f9a086c req-4e119779-31fb-4386-b79d-ca17f5d2fb46 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] No waiting events found dispatching network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:34 user nova-compute[74131]: WARNING nova.compute.manager [req-556703cc-aaf1-454a-b9fb-d2817f9a086c req-4e119779-31fb-4386-b79d-ca17f5d2fb46 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received unexpected event network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 for instance with vm_state building and task_state spawning.
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:25:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:25:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.policy [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501cfb16d7aa4ef78ea393a53b7aa555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e81e0cc8c84c22bcb419d79a119364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:25:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Creating image(s)
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.211s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk 1073741824" returned: 0 in 0.053s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Cannot resize image /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Ensure instance console log exists: /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Successfully created port: 6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-617df85a-7de3-4a23-89de-b2502081623c req-f0e196fb-1fbe-4b3b-b86e-611c7948a45e service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-617df85a-7de3-4a23-89de-b2502081623c req-f0e196fb-1fbe-4b3b-b86e-611c7948a45e service nova] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-617df85a-7de3-4a23-89de-b2502081623c req-f0e196fb-1fbe-4b3b-b86e-611c7948a45e service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-617df85a-7de3-4a23-89de-b2502081623c req-f0e196fb-1fbe-4b3b-b86e-611c7948a45e service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-617df85a-7de3-4a23-89de-b2502081623c req-f0e196fb-1fbe-4b3b-b86e-611c7948a45e service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] No waiting events found dispatching network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:36 user nova-compute[74131]: WARNING nova.compute.manager [req-617df85a-7de3-4a23-89de-b2502081623c req-f0e196fb-1fbe-4b3b-b86e-611c7948a45e service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received unexpected event network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 for instance with vm_state building and task_state spawning.
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:25:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Instance spawned successfully.
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:36 user nova-compute[74131]: INFO nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Took 6.43 seconds to spawn the instance on the hypervisor.
Oct 20 16:25:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:25:36 user nova-compute[74131]: INFO nova.compute.manager [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Took 7.24 seconds to build instance.
Oct 20 16:25:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d41087b4-a586-45be-bf98-0dc1abf1b513 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.361s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Successfully updated port: 6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquired lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing instance network info cache due to event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] Acquiring lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Releasing lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance network_info: |[{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] Acquired lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.network.neutron [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Start _get_guest_xml network_info=[{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:25:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:25:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-976985580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-976985580',id=16,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVp9HZPyBmzXnZTVreymlvmqKM0FHfm/W5XKKYwI1AtVnw/zg7hXFbiOVKCYyHrV1fysjXPYeiMHX8blrvhaCQIboEP/l4Knd5znTivp0fMjMxKFUiZ2PARnMXKugz+iw==',key_name='tempest-keypair-1923835951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-qaz16zij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=52b4f002-76fb-45c7-8b60-25c56d40740c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.objects.instance [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:25:38 user nova-compute[74131]:   <uuid>52b4f002-76fb-45c7-8b60-25c56d40740c</uuid>
Oct 20 16:25:38 user nova-compute[74131]:   <name>instance-00000010</name>
Oct 20 16:25:38 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:25:38 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:25:38 user nova-compute[74131]:   <metadata>
Oct 20 16:25:38 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:25:38 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:25:38 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-976985580</nova:name>
Oct 20 16:25:38 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:25:37</nova:creationTime>
Oct 20 16:25:38 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:25:38 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:25:38 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:25:38 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:25:38 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:25:38 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:25:38 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:25:38 user nova-compute[74131]:       <nova:owner>
Oct 20 16:25:38 user nova-compute[74131]:         <nova:user uuid="501cfb16d7aa4ef78ea393a53b7aa555">tempest-AttachVolumeShelveTestJSON-189572795-project-member</nova:user>
Oct 20 16:25:38 user nova-compute[74131]:         <nova:project uuid="02e81e0cc8c84c22bcb419d79a119364">tempest-AttachVolumeShelveTestJSON-189572795</nova:project>
Oct 20 16:25:38 user nova-compute[74131]:       </nova:owner>
Oct 20 16:25:38 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:25:38 user nova-compute[74131]:       <nova:ports>
Oct 20 16:25:38 user nova-compute[74131]:         <nova:port uuid="6b904706-24ea-4eb8-93d6-577ddeaef64b">
Oct 20 16:25:38 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 16:25:38 user nova-compute[74131]:         </nova:port>
Oct 20 16:25:38 user nova-compute[74131]:       </nova:ports>
Oct 20 16:25:38 user nova-compute[74131]:     </nova:instance>
Oct 20 16:25:38 user nova-compute[74131]:   </metadata>
Oct 20 16:25:38 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:25:38 user nova-compute[74131]:     <system>
Oct 20 16:25:38 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:25:38 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:25:38 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:25:38 user nova-compute[74131]:       <entry name="serial">52b4f002-76fb-45c7-8b60-25c56d40740c</entry>
Oct 20 16:25:38 user nova-compute[74131]:       <entry name="uuid">52b4f002-76fb-45c7-8b60-25c56d40740c</entry>
Oct 20 16:25:38 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:25:38 user nova-compute[74131]:     </system>
Oct 20 16:25:38 user nova-compute[74131]:   </sysinfo>
Oct 20 16:25:38 user nova-compute[74131]:   <os>
Oct 20 16:25:38 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:25:38 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:25:38 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:25:38 user nova-compute[74131]:   </os>
Oct 20 16:25:38 user nova-compute[74131]:   <features>
Oct 20 16:25:38 user nova-compute[74131]:     <acpi/>
Oct 20 16:25:38 user nova-compute[74131]:     <apic/>
Oct 20 16:25:38 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:25:38 user nova-compute[74131]:   </features>
Oct 20 16:25:38 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:25:38 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:25:38 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:25:38 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:25:38 user nova-compute[74131]:   </clock>
Oct 20 16:25:38 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:25:38 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:25:38 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:25:38 user nova-compute[74131]:   </cpu>
Oct 20 16:25:38 user nova-compute[74131]:   <devices>
Oct 20 16:25:38 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:25:38 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:25:38 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk"/>
Oct 20 16:25:38 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:25:38 user nova-compute[74131]:     </disk>
Oct 20 16:25:38 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:25:38 user nova-compute[74131]:       <mac address="fa:16:3e:cf:c6:30"/>
Oct 20 16:25:38 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:25:38 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:25:38 user nova-compute[74131]:       <target dev="tap6b904706-24"/>
Oct 20 16:25:38 user nova-compute[74131]:     </interface>
Oct 20 16:25:38 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:25:38 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/console.log" append="off"/>
Oct 20 16:25:38 user nova-compute[74131]:     </serial>
Oct 20 16:25:38 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:25:38 user nova-compute[74131]:     <video>
Oct 20 16:25:38 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:25:38 user nova-compute[74131]:     </video>
Oct 20 16:25:38 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:25:38 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:25:38 user nova-compute[74131]:     </rng>
Oct 20 16:25:38 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:25:38 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:25:38 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:25:38 user nova-compute[74131]:     </memballoon>
Oct 20 16:25:38 user nova-compute[74131]:   </devices>
Oct 20 16:25:38 user nova-compute[74131]: </domain>
Oct 20 16:25:38 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-976985580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-976985580',id=16,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVp9HZPyBmzXnZTVreymlvmqKM0FHfm/W5XKKYwI1AtVnw/zg7hXFbiOVKCYyHrV1fysjXPYeiMHX8blrvhaCQIboEP/l4Knd5znTivp0fMjMxKFUiZ2PARnMXKugz+iw==',key_name='tempest-keypair-1923835951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-qaz16zij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=52b4f002-76fb-45c7-8b60-25c56d40740c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG os_vif [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32c090bd-6881-5435-9f03-716f251780e2', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b904706-24, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b904706-24, col_values=(('qos', UUID('1c53db6e-df76-43c3-b355-a0c44ed2b245')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b904706-24, col_values=(('external_ids', {'iface-id': '6b904706-24ea-4eb8-93d6-577ddeaef64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c6:30', 'vm-uuid': '52b4f002-76fb-45c7-8b60-25c56d40740c'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:38 user nova-compute[74131]: INFO os_vif [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24')
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No VIF found with MAC fa:16:3e:cf:c6:30, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.network.neutron [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updated VIF entry in instance network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG nova.network.neutron [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8b7a253b-3cec-45ee-9008-80240b0da001 req-3088760b-8046-462f-b495-dbdd582c36db service nova] Releasing lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:25:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-319b1633-f6e4-42ff-9927-21ffe1cbf36c req-d6c7203b-b405-45f7-8e76-ec2ddf65edd6 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-319b1633-f6e4-42ff-9927-21ffe1cbf36c req-d6c7203b-b405-45f7-8e76-ec2ddf65edd6 service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-319b1633-f6e4-42ff-9927-21ffe1cbf36c req-d6c7203b-b405-45f7-8e76-ec2ddf65edd6 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-319b1633-f6e4-42ff-9927-21ffe1cbf36c req-d6c7203b-b405-45f7-8e76-ec2ddf65edd6 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-319b1633-f6e4-42ff-9927-21ffe1cbf36c req-d6c7203b-b405-45f7-8e76-ec2ddf65edd6 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:40 user nova-compute[74131]: WARNING nova.compute.manager [req-319b1633-f6e4-42ff-9927-21ffe1cbf36c req-d6c7203b-b405-45f7-8e76-ec2ddf65edd6 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received unexpected event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with vm_state building and task_state spawning.
Oct 20 16:25:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:41 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3e22a492-a812-415d-92c1-3cc51b842cc0 is timed out.
Oct 20 16:25:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully detached device vdb from instance 3e22a492-a812-415d-92c1-3cc51b842cc0 from the live domain config.
Oct 20 16:25:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMAzHhfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:25:41 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e36f54e-f1de-4973-9e56-f0d7b3e4ed64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:25:41 user nova-compute[74131]: No targets found.
Oct 20 16:25:41 user nova-compute[74131]: iSNS:
Oct 20 16:25:41 user nova-compute[74131]: No targets found.
Oct 20 16:25:41 user nova-compute[74131]: STATIC:
Oct 20 16:25:41 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:25:41 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:25:41 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:25:41 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63
Oct 20 16:25:41 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:25:41 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:25:41 user nova-compute[74131]: FIRMWARE:
Oct 20 16:25:41 user nova-compute[74131]: No targets found.
Oct 20 16:25:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:25:41 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:25:41 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[90380344-6eff-4c6c-bf50-2ea624d07609]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eccb64b-7b0f-4fb4-95c0-fbb4608fc67f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:25:41 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:25:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:25:41 user nova-compute[74131]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 (non-flash)
Oct 20 16:25:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a877be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63'): ({'sdd'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Removing single pathed devices sdd {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5bc418-4d71-4a72-8800-a8e8307d2700]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b39a0-8b15-4a21-a286-e6108878c007]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flushing IO for device /dev/sdd {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d82e58-7f87-4916-afa2-54d13666e100]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:25:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5a608f-da4a-4563-8dd2-fb05b4d5570a]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dd4ebe-7ccf-4403-84aa-910c2e78c995]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[624e5fbd-bb19-4928-adf4-325c36bc873e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260]
Oct 20 16:25:42 user nova-compute[74131]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63, portal: 172.16.0.220,3260] successful.
Oct 20 16:25:42 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:387825ee-5645-4ed4-9f4a-0eec9182ec63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[91542e5a-f9a0-4028-855a-8798e67aaf4a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== disconnect_volume: return (435ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-5d8ff4d6-8df6-4e0f-b8b7-363d6e16feb7 req-8e158ab7-a7f7-44af-aafa-52aa2e672934 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5d8ff4d6-8df6-4e0f-b8b7-363d6e16feb7 req-8e158ab7-a7f7-44af-aafa-52aa2e672934 service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5d8ff4d6-8df6-4e0f-b8b7-363d6e16feb7 req-8e158ab7-a7f7-44af-aafa-52aa2e672934 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5d8ff4d6-8df6-4e0f-b8b7-363d6e16feb7 req-8e158ab7-a7f7-44af-aafa-52aa2e672934 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-5d8ff4d6-8df6-4e0f-b8b7-363d6e16feb7 req-8e158ab7-a7f7-44af-aafa-52aa2e672934 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:42 user nova-compute[74131]: WARNING nova.compute.manager [req-5d8ff4d6-8df6-4e0f-b8b7-363d6e16feb7 req-8e158ab7-a7f7-44af-aafa-52aa2e672934 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received unexpected event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with vm_state building and task_state spawning.
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:25:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance spawned successfully.
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:43 user nova-compute[74131]: INFO nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Took 8.24 seconds to spawn the instance on the hypervisor.
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:25:43 user nova-compute[74131]: INFO nova.compute.manager [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Took 9.57 seconds to build instance.
Oct 20 16:25:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cdeddcb8-3c17-439b-8007-10589b2461cf tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.706s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-813e7981-7cd7-4823-bc95-f0e7fab58b33 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.636s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.972s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:46 user nova-compute[74131]: INFO nova.compute.manager [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Terminating instance
Oct 20 16:25:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-ddbc7454-ad5c-4a44-8dce-981967282e87 req-7c21773a-bb5c-4fe9-b005-317b40c53b31 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-vif-unplugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ddbc7454-ad5c-4a44-8dce-981967282e87 req-7c21773a-bb5c-4fe9-b005-317b40c53b31 service nova] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ddbc7454-ad5c-4a44-8dce-981967282e87 req-7c21773a-bb5c-4fe9-b005-317b40c53b31 service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ddbc7454-ad5c-4a44-8dce-981967282e87 req-7c21773a-bb5c-4fe9-b005-317b40c53b31 service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-ddbc7454-ad5c-4a44-8dce-981967282e87 req-7c21773a-bb5c-4fe9-b005-317b40c53b31 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] No waiting events found dispatching network-vif-unplugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-ddbc7454-ad5c-4a44-8dce-981967282e87 req-7c21773a-bb5c-4fe9-b005-317b40c53b31 service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-vif-unplugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Instance destroyed successfully.
Oct 20 16:25:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lazy-loading 'resources' on Instance uuid 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-920156016',display_name='tempest-TestServerVolumeAttachmentScenario-server-920156016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-920156016',id=11,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIChedWnd+1CIYNVcKzFq9n8m0mLo6ZtocrNTjqLprRKowUP9KGgFjdUHb2/hOcScwrpX0MmKLdme1bcnZe5awzTzokQTHiLtoMDmYu6Lmduc32+NSq8WLhTggH2niwBw==',key_name='tempest-keypair-1712730949',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b057c4fc24fb45e0a5bbf7ec5993c5a7',ramdisk_id='',reservation_id='r-704xenid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-634653240',owner_user_name='tempest-TestServerVolumeAttachmentScenario-634653240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9672540d35b644bda7c5f006cecc6870',uuid=97808f8f-f8ae-40b6-ae3a-b7a209a2a64d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Converting VIF {"id": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "address": "fa:16:3e:6e:26:88", "network": {"id": "04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264469306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b057c4fc24fb45e0a5bbf7ec5993c5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08fc7c0-8c", "ovs_interfaceid": "c08fc7c0-8c6d-4d94-8e25-7dabdd052274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:26:88,bridge_name='br-int',has_traffic_filtering=True,id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274,network=Network(04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc08fc7c0-8c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG os_vif [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:26:88,bridge_name='br-int',has_traffic_filtering=True,id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274,network=Network(04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc08fc7c0-8c') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc08fc7c0-8c, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98ba1103-5c8d-466b-a186-813c6ecfb3af) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:47 user nova-compute[74131]: INFO os_vif [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:26:88,bridge_name='br-int',has_traffic_filtering=True,id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274,network=Network(04bafa85-eb4f-4f4c-bd4c-3ca49ee057c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc08fc7c0-8c')
Oct 20 16:25:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Deleting instance files /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d_del
Oct 20 16:25:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Deletion of /opt/stack/data/nova/instances/97808f8f-f8ae-40b6-ae3a-b7a209a2a64d_del complete
Oct 20 16:25:48 user nova-compute[74131]: INFO nova.compute.manager [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 20 16:25:48 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:25:48 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:25:48 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:49 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Took 1.12 seconds to deallocate network for instance.
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-fa587f1d-a7e2-449d-916c-3dc08d4aaf02 req-049b9cd9-5ab4-496c-8015-da7ea5afe37e service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-vif-deleted-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:49 user nova-compute[74131]: INFO nova.compute.manager [req-fa587f1d-a7e2-449d-916c-3dc08d4aaf02 req-049b9cd9-5ab4-496c-8015-da7ea5afe37e service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Neutron deleted interface c08fc7c0-8c6d-4d94-8e25-7dabdd052274; detaching it from the instance and deleting it from the info cache
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.network.neutron [req-fa587f1d-a7e2-449d-916c-3dc08d4aaf02 req-049b9cd9-5ab4-496c-8015-da7ea5afe37e service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-fa587f1d-a7e2-449d-916c-3dc08d4aaf02 req-049b9cd9-5ab4-496c-8015-da7ea5afe37e service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Detach interface failed, port_id=c08fc7c0-8c6d-4d94-8e25-7dabdd052274, reason: Instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-ea07e8d0-4025-40c6-8f26-f0f2abf838ff req-9dbdc3ed-b82d-440a-a0c5-6ff996abd03b service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received event network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea07e8d0-4025-40c6-8f26-f0f2abf838ff req-9dbdc3ed-b82d-440a-a0c5-6ff996abd03b service nova] Acquiring lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea07e8d0-4025-40c6-8f26-f0f2abf838ff req-9dbdc3ed-b82d-440a-a0c5-6ff996abd03b service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea07e8d0-4025-40c6-8f26-f0f2abf838ff req-9dbdc3ed-b82d-440a-a0c5-6ff996abd03b service nova] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-ea07e8d0-4025-40c6-8f26-f0f2abf838ff req-9dbdc3ed-b82d-440a-a0c5-6ff996abd03b service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] No waiting events found dispatching network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:25:49 user nova-compute[74131]: WARNING nova.compute.manager [req-ea07e8d0-4025-40c6-8f26-f0f2abf838ff req-9dbdc3ed-b82d-440a-a0c5-6ff996abd03b service nova] [instance: 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d] Received unexpected event network-vif-plugged-c08fc7c0-8c6d-4d94-8e25-7dabdd052274 for instance with vm_state deleted and task_state None.
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:49 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Deleted allocations for instance 97808f8f-f8ae-40b6-ae3a-b7a209a2a64d
Oct 20 16:25:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-750699be-82e7-47b8-bd29-2aa558a18896 tempest-TestServerVolumeAttachmentScenario-634653240 tempest-TestServerVolumeAttachmentScenario-634653240-project-member] Lock "97808f8f-f8ae-40b6-ae3a-b7a209a2a64d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.771s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:25:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:25:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:08 user nova-compute[74131]: INFO nova.compute.manager [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Terminating instance
Oct 20 16:26:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-b77d1289-85f2-47ce-9d67-f151e827abcd req-f97cebed-5310-44eb-a634-7d5f4fe24245 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-unplugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b77d1289-85f2-47ce-9d67-f151e827abcd req-f97cebed-5310-44eb-a634-7d5f4fe24245 service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b77d1289-85f2-47ce-9d67-f151e827abcd req-f97cebed-5310-44eb-a634-7d5f4fe24245 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b77d1289-85f2-47ce-9d67-f151e827abcd req-f97cebed-5310-44eb-a634-7d5f4fe24245 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-b77d1289-85f2-47ce-9d67-f151e827abcd req-f97cebed-5310-44eb-a634-7d5f4fe24245 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-unplugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-b77d1289-85f2-47ce-9d67-f151e827abcd req-f97cebed-5310-44eb-a634-7d5f4fe24245 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-unplugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:26:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Instance destroyed successfully.
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.objects.instance [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lazy-loading 'resources' on Instance uuid d2f0a264-c008-4a8d-a043-e3d391371e03 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1685753138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2143544802',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc4XMoxY4Dg+61kJ87kel36Y/5nH7VTQZrzEJv51BivlA49XZaf3Bj9QPbaGeYwls5bkzRLFgBw92nCYLyRqtpE8UqiU8SJyy2XjeM7IMfT3Enbm1zJVOMIEoid2i/ueQ==',key_name='tempest-keypair-694396898',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='271c255eceee494a88cb94ce0782cdac',ramdisk_id='',reservation_id='r-kb184yfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153044646',owner_user_name='tempest-ServerActionsV293TestJSON-153044646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:24:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7afdf3b099374db9a370162d951c9f9c',uuid=d2f0a264-c008-4a8d-a043-e3d391371e03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converting VIF {"id": "c9e6dc02-3b44-4572-ba36-213377f08203", "address": "fa:16:3e:89:15:de", "network": {"id": "97d13402-cf52-4786-8564-c23b9bd6f9d0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1119820928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "271c255eceee494a88cb94ce0782cdac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e6dc02-3b", "ovs_interfaceid": "c9e6dc02-3b44-4572-ba36-213377f08203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_vif [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9e6dc02-3b, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ceec6a2f-f96b-4ad7-b483-847820de2acd) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:09 user nova-compute[74131]: INFO os_vif [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:15:de,bridge_name='br-int',has_traffic_filtering=True,id=c9e6dc02-3b44-4572-ba36-213377f08203,network=Network(97d13402-cf52-4786-8564-c23b9bd6f9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e6dc02-3b')
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnoeEyXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:26:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4426e68c-9fb9-4879-9cfc-50e1e6072b1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:26:09 user nova-compute[74131]: No targets found.
Oct 20 16:26:09 user nova-compute[74131]: iSNS:
Oct 20 16:26:09 user nova-compute[74131]: No targets found.
Oct 20 16:26:09 user nova-compute[74131]: STATIC:
Oct 20 16:26:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158
Oct 20 16:26:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:26:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:26:09 user nova-compute[74131]: FIRMWARE:
Oct 20 16:26:09 user nova-compute[74131]: No targets found.
Oct 20 16:26:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:26:09 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:26:09 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea0d17-8cf8-4aa8-a098-302ab9fb92cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b55c3-deba-4093-8a49-59123b7e8c24]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:26:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 (non-flash)
Oct 20 16:26:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c86da950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158'): ({'sdm'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Removing single pathed devices sdm {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52c998e-25be-40ed-8b68-334a11b1b784]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb678d26-9291-4f1e-a105-231b08948a13]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Flushing IO for device /dev/sdm {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3818f02a-5ac5-43d9-b94e-65d3df5ffa2f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d187baa-cb4f-4df0-80ce-36a3efca2e44]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] SCSI volumes sdm have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ff1afbef', '/dev/disk/by-id/scsi-26463356233643339', '/dev/disk/by-id/scsi-1SCST_BIOff1afbef-dc5b3d39f26379a4') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe6aa6c-92e2-4311-8020-8e7fb0b4525a]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.102s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b33488f-8637-4d30-9260-484ddbcbcbc5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba4d8ab-a37a-47c5-b260-66a18f584ad1]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260]
Oct 20 16:26:09 user nova-compute[74131]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158, portal: 172.16.0.220,3260] successful.
Oct 20 16:26:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c25cebe-bc8c-40af-81e6-4d28c5e7f158 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd99654-55d2-463f-a9fd-0eef4b92f5ad]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] <== disconnect_volume: return (448ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:26:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Deleting instance files /opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03_del
Oct 20 16:26:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Deletion of /opt/stack/data/nova/instances/d2f0a264-c008-4a8d-a043-e3d391371e03_del complete
Oct 20 16:26:09 user nova-compute[74131]: INFO nova.compute.manager [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 20 16:26:09 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:26:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:10 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:10 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Took 0.78 seconds to deallocate network for instance.
Oct 20 16:26:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-c869f85b-75c4-47c4-9595-50d0f81edaf3 req-b481f724-ffa0-49c4-95ae-1c3ab8b22136 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-deleted-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-e46d63d3-1d16-473d-966e-686611bd438a req-5c4c89c2-99c9-4153-b74f-5dac0185d0d2 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e46d63d3-1d16-473d-966e-686611bd438a req-5c4c89c2-99c9-4153-b74f-5dac0185d0d2 service nova] Acquiring lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e46d63d3-1d16-473d-966e-686611bd438a req-5c4c89c2-99c9-4153-b74f-5dac0185d0d2 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e46d63d3-1d16-473d-966e-686611bd438a req-5c4c89c2-99c9-4153-b74f-5dac0185d0d2 service nova] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-e46d63d3-1d16-473d-966e-686611bd438a req-5c4c89c2-99c9-4153-b74f-5dac0185d0d2 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] No waiting events found dispatching network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:10 user nova-compute[74131]: WARNING nova.compute.manager [req-e46d63d3-1d16-473d-966e-686611bd438a req-5c4c89c2-99c9-4153-b74f-5dac0185d0d2 service nova] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Received unexpected event network-vif-plugged-c9e6dc02-3b44-4572-ba36-213377f08203 for instance with vm_state active and task_state deleting.
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:11 user nova-compute[74131]: INFO nova.compute.manager [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Terminating instance
Oct 20 16:26:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:26:11 user nova-compute[74131]: INFO nova.compute.manager [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Took 0.89 seconds to detach 1 volumes for instance.
Oct 20 16:26:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] [instance: d2f0a264-c008-4a8d-a043-e3d391371e03] Deleting volume: 3c25cebe-bc8c-40af-81e6-4d28c5e7f158 {{(pid=74131) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:26:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:11 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Deleted allocations for instance d2f0a264-c008-4a8d-a043-e3d391371e03
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d2ffe97b-de00-4ab2-83d9-2a2b2b54b905 tempest-ServerActionsV293TestJSON-153044646 tempest-ServerActionsV293TestJSON-153044646-project-member] Lock "d2f0a264-c008-4a8d-a043-e3d391371e03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.661s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Instance destroyed successfully.
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'resources' on Instance uuid 3e22a492-a812-415d-92c1-3cc51b842cc0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-695004177',display_name='tempest-AttachVolumeNegativeTest-server-695004177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-695004177',id=2,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUjjfQT09wNt+FeE7pZlx0dnkQuGAl2qxXirqFl85FyC36hfFSqHMML7ux7QfNzkbTHGbz1ZdZDf6L/oayvayP5vSs6t8a0XZCvbSECXkfVoFQoIIH4tiQlSHGRyWYYMw==',key_name='tempest-keypair-1811474218',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-uq9q0hpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=3e22a492-a812-415d-92c1-3cc51b842cc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "address": "fa:16:3e:3b:0b:93", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c05f0f-9d", "ovs_interfaceid": "f9c05f0f-9d46-4970-a524-d66c38905e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0b:93,bridge_name='br-int',has_traffic_filtering=True,id=f9c05f0f-9d46-4970-a524-d66c38905e0e,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c05f0f-9d') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG os_vif [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0b:93,bridge_name='br-int',has_traffic_filtering=True,id=f9c05f0f-9d46-4970-a524-d66c38905e0e,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c05f0f-9d') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9c05f0f-9d, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a034c3fb-f8cf-4858-81d3-041fba0d334c) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:12 user nova-compute[74131]: INFO os_vif [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0b:93,bridge_name='br-int',has_traffic_filtering=True,id=f9c05f0f-9d46-4970-a524-d66c38905e0e,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c05f0f-9d')
Oct 20 16:26:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Deleting instance files /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0_del
Oct 20 16:26:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Deletion of /opt/stack/data/nova/instances/3e22a492-a812-415d-92c1-3cc51b842cc0_del complete
Oct 20 16:26:12 user nova-compute[74131]: INFO nova.compute.manager [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-vif-unplugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] No waiting events found dispatching network-vif-unplugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-vif-unplugged-f9c05f0f-9d46-4970-a524-d66c38905e0e for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] Acquiring lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] No waiting events found dispatching network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:13 user nova-compute[74131]: WARNING nova.compute.manager [req-8af7ed64-40ad-429c-ba85-51467a2c6b04 req-134baac6-5bc0-4270-b818-5e11920e68b5 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received unexpected event network-vif-plugged-f9c05f0f-9d46-4970-a524-d66c38905e0e for instance with vm_state active and task_state deleting.
Oct 20 16:26:13 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:13 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Took 1.47 seconds to deallocate network for instance.
Oct 20 16:26:13 user nova-compute[74131]: DEBUG nova.compute.manager [req-f170bab3-79fd-477f-9529-d1af670554ee req-4b5895f4-965c-415c-aa2a-7a1500612943 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Received event network-vif-deleted-f9c05f0f-9d46-4970-a524-d66c38905e0e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:13 user nova-compute[74131]: INFO nova.compute.manager [req-f170bab3-79fd-477f-9529-d1af670554ee req-4b5895f4-965c-415c-aa2a-7a1500612943 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Neutron deleted interface f9c05f0f-9d46-4970-a524-d66c38905e0e; detaching it from the instance and deleting it from the info cache
Oct 20 16:26:13 user nova-compute[74131]: DEBUG nova.network.neutron [req-f170bab3-79fd-477f-9529-d1af670554ee req-4b5895f4-965c-415c-aa2a-7a1500612943 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:13 user nova-compute[74131]: DEBUG nova.compute.manager [req-f170bab3-79fd-477f-9529-d1af670554ee req-4b5895f4-965c-415c-aa2a-7a1500612943 service nova] [instance: 3e22a492-a812-415d-92c1-3cc51b842cc0] Detach interface failed, port_id=f9c05f0f-9d46-4970-a524-d66c38905e0e, reason: Instance 3e22a492-a812-415d-92c1-3cc51b842cc0 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:26:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:26:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:26:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:14 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Deleted allocations for instance 3e22a492-a812-415d-92c1-3cc51b842cc0
Oct 20 16:26:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7ec31316-302d-476f-9bad-0fba64c9f1c1 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "3e22a492-a812-415d-92c1-3cc51b842cc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:26:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:26:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:26:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:26:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Updating instance_info_cache with network_info: [{"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:26:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=25.59842300415039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 0c360989-4303-456b-af5d-bb341e654098 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 52b4f002-76fb-45c7-8b60-25c56d40740c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:26:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:26:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:41 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:26:41 user nova-compute[74131]: INFO nova.compute.claims [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Claim successful on node user
Oct 20 16:26:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:26:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:26:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Creating image(s)
Oct 20 16:26:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG nova.policy [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72a97cc9f5e947c19c91e9f39a3ff550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11d09248b04962964ad7f47275a2d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:26:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.215s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk 1073741824" returned: 0 in 0.069s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.220s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Cannot resize image /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Ensure instance console log exists: /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Successfully created port: 3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:26:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Successfully updated port: 3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing instance network info cache due to event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:26:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance network_info: |[{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.neutron [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Start _get_guest_xml network_info=[{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:26:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-447823817',display_name='tempest-ServerStableDeviceRescueTest-server-447823817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-447823817',id=17,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFncVUjULMjWlv7/khPkG+gUk9kJKtqLh6194ST9QWIhoqdt30J9vNE2m2+X8p5mbqpA2A0wOS2CLlIf6kljzOofXEo0C8y6Vx/aPVzgsfijCalCmczjb5nqXPiG4INkw==',key_name='tempest-keypair-392604751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff11d09248b04962964ad7f47275a2d5',ramdisk_id='',reservation_id='r-vpxn1dqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-472624141',owner_user_name='tempest-ServerStableDeviceRescueTest-472624141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a97cc9f5e947c19c91e9f39a3ff550',uuid=9ff2e5d8-f854-4f8b-941f-17ba5e47caff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converting VIF {"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:26:46 user nova-compute[74131]:   <uuid>9ff2e5d8-f854-4f8b-941f-17ba5e47caff</uuid>
Oct 20 16:26:46 user nova-compute[74131]:   <name>instance-00000011</name>
Oct 20 16:26:46 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:26:46 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:26:46 user nova-compute[74131]:   <metadata>
Oct 20 16:26:46 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:26:46 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:26:46 user nova-compute[74131]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-447823817</nova:name>
Oct 20 16:26:46 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:26:46</nova:creationTime>
Oct 20 16:26:46 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:26:46 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:26:46 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:26:46 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:26:46 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:26:46 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:26:46 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:26:46 user nova-compute[74131]:       <nova:owner>
Oct 20 16:26:46 user nova-compute[74131]:         <nova:user uuid="72a97cc9f5e947c19c91e9f39a3ff550">tempest-ServerStableDeviceRescueTest-472624141-project-member</nova:user>
Oct 20 16:26:46 user nova-compute[74131]:         <nova:project uuid="ff11d09248b04962964ad7f47275a2d5">tempest-ServerStableDeviceRescueTest-472624141</nova:project>
Oct 20 16:26:46 user nova-compute[74131]:       </nova:owner>
Oct 20 16:26:46 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:26:46 user nova-compute[74131]:       <nova:ports>
Oct 20 16:26:46 user nova-compute[74131]:         <nova:port uuid="3058f4d2-f621-46ec-b677-b5161dba512f">
Oct 20 16:26:46 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 16:26:46 user nova-compute[74131]:         </nova:port>
Oct 20 16:26:46 user nova-compute[74131]:       </nova:ports>
Oct 20 16:26:46 user nova-compute[74131]:     </nova:instance>
Oct 20 16:26:46 user nova-compute[74131]:   </metadata>
Oct 20 16:26:46 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:26:46 user nova-compute[74131]:     <system>
Oct 20 16:26:46 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:26:46 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:26:46 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:26:46 user nova-compute[74131]:       <entry name="serial">9ff2e5d8-f854-4f8b-941f-17ba5e47caff</entry>
Oct 20 16:26:46 user nova-compute[74131]:       <entry name="uuid">9ff2e5d8-f854-4f8b-941f-17ba5e47caff</entry>
Oct 20 16:26:46 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:26:46 user nova-compute[74131]:     </system>
Oct 20 16:26:46 user nova-compute[74131]:   </sysinfo>
Oct 20 16:26:46 user nova-compute[74131]:   <os>
Oct 20 16:26:46 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:26:46 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:26:46 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:26:46 user nova-compute[74131]:   </os>
Oct 20 16:26:46 user nova-compute[74131]:   <features>
Oct 20 16:26:46 user nova-compute[74131]:     <acpi/>
Oct 20 16:26:46 user nova-compute[74131]:     <apic/>
Oct 20 16:26:46 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:26:46 user nova-compute[74131]:   </features>
Oct 20 16:26:46 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:26:46 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:26:46 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:26:46 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:26:46 user nova-compute[74131]:   </clock>
Oct 20 16:26:46 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:26:46 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:26:46 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:26:46 user nova-compute[74131]:   </cpu>
Oct 20 16:26:46 user nova-compute[74131]:   <devices>
Oct 20 16:26:46 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:26:46 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:26:46 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk"/>
Oct 20 16:26:46 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:26:46 user nova-compute[74131]:     </disk>
Oct 20 16:26:46 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:26:46 user nova-compute[74131]:       <mac address="fa:16:3e:97:63:35"/>
Oct 20 16:26:46 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:26:46 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:26:46 user nova-compute[74131]:       <target dev="tap3058f4d2-f6"/>
Oct 20 16:26:46 user nova-compute[74131]:     </interface>
Oct 20 16:26:46 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:26:46 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/console.log" append="off"/>
Oct 20 16:26:46 user nova-compute[74131]:     </serial>
Oct 20 16:26:46 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:26:46 user nova-compute[74131]:     <video>
Oct 20 16:26:46 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:26:46 user nova-compute[74131]:     </video>
Oct 20 16:26:46 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:26:46 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:26:46 user nova-compute[74131]:     </rng>
Oct 20 16:26:46 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:26:46 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:26:46 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:26:46 user nova-compute[74131]:     </memballoon>
Oct 20 16:26:46 user nova-compute[74131]:   </devices>
Oct 20 16:26:46 user nova-compute[74131]: </domain>
Oct 20 16:26:46 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-447823817',display_name='tempest-ServerStableDeviceRescueTest-server-447823817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-447823817',id=17,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFncVUjULMjWlv7/khPkG+gUk9kJKtqLh6194ST9QWIhoqdt30J9vNE2m2+X8p5mbqpA2A0wOS2CLlIf6kljzOofXEo0C8y6Vx/aPVzgsfijCalCmczjb5nqXPiG4INkw==',key_name='tempest-keypair-392604751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff11d09248b04962964ad7f47275a2d5',ramdisk_id='',reservation_id='r-vpxn1dqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-472624141',owner_user_name='tempest-ServerStableDeviceRescueTest-472624141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a97cc9f5e947c19c91e9f39a3ff550',uuid=9ff2e5d8-f854-4f8b-941f-17ba5e47caff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converting VIF {"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG os_vif [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17200c17-6755-526e-8597-8ceb2916c11f', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3058f4d2-f6, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3058f4d2-f6, col_values=(('qos', UUID('feb0487e-c956-4afa-9337-901668f72f1f')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3058f4d2-f6, col_values=(('external_ids', {'iface-id': '3058f4d2-f621-46ec-b677-b5161dba512f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:63:35', 'vm-uuid': '9ff2e5d8-f854-4f8b-941f-17ba5e47caff'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:46 user nova-compute[74131]: INFO os_vif [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6')
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No VIF found with MAC fa:16:3e:97:63:35, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.neutron [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updated VIF entry in instance network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG nova.network.neutron [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c7417c7a-29df-44e9-bdf0-d1667a568379 req-bc47bc0f-0088-46b8-bd91-1940b6ff1619 service nova] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:26:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-bb7c600d-20a7-431b-a922-a79f25f4a4b4 req-f4a381a4-d8e7-49ac-a335-b17afc1ad06e service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bb7c600d-20a7-431b-a922-a79f25f4a4b4 req-f4a381a4-d8e7-49ac-a335-b17afc1ad06e service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bb7c600d-20a7-431b-a922-a79f25f4a4b4 req-f4a381a4-d8e7-49ac-a335-b17afc1ad06e service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bb7c600d-20a7-431b-a922-a79f25f4a4b4 req-f4a381a4-d8e7-49ac-a335-b17afc1ad06e service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-bb7c600d-20a7-431b-a922-a79f25f4a4b4 req-f4a381a4-d8e7-49ac-a335-b17afc1ad06e service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:48 user nova-compute[74131]: WARNING nova.compute.manager [req-bb7c600d-20a7-431b-a922-a79f25f4a4b4 req-f4a381a4-d8e7-49ac-a335-b17afc1ad06e service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state building and task_state spawning.
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:26:48 user nova-compute[74131]: INFO nova.compute.claims [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Claim successful on node user
Oct 20 16:26:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:26:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:26:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:26:49 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Creating image(s)
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "/opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "/opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG nova.policy [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb36fa11f0e046f3b76fe0854b333289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009462210022422a989156ddb05b7dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.232s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.216s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk 1073741824" returned: 0 in 0.073s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:26:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Cannot resize image /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Ensure instance console log exists: /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:26:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance spawned successfully.
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3a8a942-77be-48eb-aaec-c2f70693da9e req-62f281bf-2f10-44ab-9d6e-4b845ca0937f service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e3a8a942-77be-48eb-aaec-c2f70693da9e req-62f281bf-2f10-44ab-9d6e-4b845ca0937f service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e3a8a942-77be-48eb-aaec-c2f70693da9e req-62f281bf-2f10-44ab-9d6e-4b845ca0937f service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e3a8a942-77be-48eb-aaec-c2f70693da9e req-62f281bf-2f10-44ab-9d6e-4b845ca0937f service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-e3a8a942-77be-48eb-aaec-c2f70693da9e req-62f281bf-2f10-44ab-9d6e-4b845ca0937f service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:50 user nova-compute[74131]: WARNING nova.compute.manager [req-e3a8a942-77be-48eb-aaec-c2f70693da9e req-62f281bf-2f10-44ab-9d6e-4b845ca0937f service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state building and task_state spawning.
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Successfully created port: b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:26:50 user nova-compute[74131]: INFO nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Took 7.63 seconds to spawn the instance on the hypervisor.
Oct 20 16:26:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:26:50 user nova-compute[74131]: INFO nova.compute.manager [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Took 8.69 seconds to build instance.
Oct 20 16:26:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e3e9a22c-f6f4-464c-98b1-a7a41d2e889b tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.838s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Successfully updated port: b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquired lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-changed-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Refreshing instance network info cache due to event network-changed-b01038b9-456e-4165-9139-f89acc4aecd1. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] Acquiring lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Updating instance_info_cache with network_info: [{"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Releasing lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Instance network_info: |[{"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] Acquired lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.network.neutron [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Refreshing network info cache for port b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Start _get_guest_xml network_info=[{"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:26:51 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:51 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1373150389',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1373150389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1373150',id=18,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yWLjnpvytj2M3A4O/8LgJawtqQ0WxzWmKKjJbaCrknzajtF8VkO1iufxYogzHbKeFIuHGtQnUsYo7fxGjeT4eDruWmYdQq0on1O8OpBwVZ10BLnUSmArM0ppLawhftg==',key_name='tempest-keypair-1060974344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009462210022422a989156ddb05b7dac',ramdisk_id='',reservation_id='r-074mrtpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-390058125',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb36fa11f0e046f3b76fe0854b333289',uuid=9aee3d08-7204-4215-9e6a-0d52766749f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Converting VIF {"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01038b9-456e-4165-9139-f89acc4aecd1,network=Network(7e118b93-7b35-4ef7-b555-300fa3f353cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01038b9-45') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:51 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lazy-loading 'pci_devices' on Instance uuid 9aee3d08-7204-4215-9e6a-0d52766749f5 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:26:52 user nova-compute[74131]:   <uuid>9aee3d08-7204-4215-9e6a-0d52766749f5</uuid>
Oct 20 16:26:52 user nova-compute[74131]:   <name>instance-00000012</name>
Oct 20 16:26:52 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:26:52 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:26:52 user nova-compute[74131]:   <metadata>
Oct 20 16:26:52 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:26:52 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:26:52 user nova-compute[74131]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1373150389</nova:name>
Oct 20 16:26:52 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:26:51</nova:creationTime>
Oct 20 16:26:52 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:26:52 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:26:52 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:26:52 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:26:52 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:26:52 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:26:52 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:26:52 user nova-compute[74131]:       <nova:owner>
Oct 20 16:26:52 user nova-compute[74131]:         <nova:user uuid="eb36fa11f0e046f3b76fe0854b333289">tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member</nova:user>
Oct 20 16:26:52 user nova-compute[74131]:         <nova:project uuid="009462210022422a989156ddb05b7dac">tempest-TestServerVolumeAttachScenarioOldVersion-390058125</nova:project>
Oct 20 16:26:52 user nova-compute[74131]:       </nova:owner>
Oct 20 16:26:52 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:26:52 user nova-compute[74131]:       <nova:ports>
Oct 20 16:26:52 user nova-compute[74131]:         <nova:port uuid="b01038b9-456e-4165-9139-f89acc4aecd1">
Oct 20 16:26:52 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 16:26:52 user nova-compute[74131]:         </nova:port>
Oct 20 16:26:52 user nova-compute[74131]:       </nova:ports>
Oct 20 16:26:52 user nova-compute[74131]:     </nova:instance>
Oct 20 16:26:52 user nova-compute[74131]:   </metadata>
Oct 20 16:26:52 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:26:52 user nova-compute[74131]:     <system>
Oct 20 16:26:52 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:26:52 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:26:52 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:26:52 user nova-compute[74131]:       <entry name="serial">9aee3d08-7204-4215-9e6a-0d52766749f5</entry>
Oct 20 16:26:52 user nova-compute[74131]:       <entry name="uuid">9aee3d08-7204-4215-9e6a-0d52766749f5</entry>
Oct 20 16:26:52 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:26:52 user nova-compute[74131]:     </system>
Oct 20 16:26:52 user nova-compute[74131]:   </sysinfo>
Oct 20 16:26:52 user nova-compute[74131]:   <os>
Oct 20 16:26:52 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:26:52 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:26:52 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:26:52 user nova-compute[74131]:   </os>
Oct 20 16:26:52 user nova-compute[74131]:   <features>
Oct 20 16:26:52 user nova-compute[74131]:     <acpi/>
Oct 20 16:26:52 user nova-compute[74131]:     <apic/>
Oct 20 16:26:52 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:26:52 user nova-compute[74131]:   </features>
Oct 20 16:26:52 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:26:52 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:26:52 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:26:52 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:26:52 user nova-compute[74131]:   </clock>
Oct 20 16:26:52 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:26:52 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:26:52 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:26:52 user nova-compute[74131]:   </cpu>
Oct 20 16:26:52 user nova-compute[74131]:   <devices>
Oct 20 16:26:52 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:26:52 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:26:52 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk"/>
Oct 20 16:26:52 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:26:52 user nova-compute[74131]:     </disk>
Oct 20 16:26:52 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:26:52 user nova-compute[74131]:       <mac address="fa:16:3e:86:7e:b3"/>
Oct 20 16:26:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:26:52 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:26:52 user nova-compute[74131]:       <target dev="tapb01038b9-45"/>
Oct 20 16:26:52 user nova-compute[74131]:     </interface>
Oct 20 16:26:52 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:26:52 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/console.log" append="off"/>
Oct 20 16:26:52 user nova-compute[74131]:     </serial>
Oct 20 16:26:52 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:26:52 user nova-compute[74131]:     <video>
Oct 20 16:26:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:26:52 user nova-compute[74131]:     </video>
Oct 20 16:26:52 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:26:52 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:26:52 user nova-compute[74131]:     </rng>
Oct 20 16:26:52 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:26:52 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:26:52 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:26:52 user nova-compute[74131]:     </memballoon>
Oct 20 16:26:52 user nova-compute[74131]:   </devices>
Oct 20 16:26:52 user nova-compute[74131]: </domain>
Oct 20 16:26:52 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1373150389',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1373150389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1373150',id=18,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yWLjnpvytj2M3A4O/8LgJawtqQ0WxzWmKKjJbaCrknzajtF8VkO1iufxYogzHbKeFIuHGtQnUsYo7fxGjeT4eDruWmYdQq0on1O8OpBwVZ10BLnUSmArM0ppLawhftg==',key_name='tempest-keypair-1060974344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009462210022422a989156ddb05b7dac',ramdisk_id='',reservation_id='r-074mrtpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-390058125',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb36fa11f0e046f3b76fe0854b333289',uuid=9aee3d08-7204-4215-9e6a-0d52766749f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Converting VIF {"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01038b9-456e-4165-9139-f89acc4aecd1,network=Network(7e118b93-7b35-4ef7-b555-300fa3f353cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01038b9-45') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG os_vif [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01038b9-456e-4165-9139-f89acc4aecd1,network=Network(7e118b93-7b35-4ef7-b555-300fa3f353cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01038b9-45') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca5733f8-3947-54c5-9b8d-222917f4fa42', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb01038b9-45, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb01038b9-45, col_values=(('qos', UUID('127d55df-9ac8-419a-a700-ceff8f25612a')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb01038b9-45, col_values=(('external_ids', {'iface-id': 'b01038b9-456e-4165-9139-f89acc4aecd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:7e:b3', 'vm-uuid': '9aee3d08-7204-4215-9e6a-0d52766749f5'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:52 user nova-compute[74131]: INFO os_vif [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01038b9-456e-4165-9139-f89acc4aecd1,network=Network(7e118b93-7b35-4ef7-b555-300fa3f353cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01038b9-45')
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] No VIF found with MAC fa:16:3e:86:7e:b3, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Updated VIF entry in instance network info cache for port b01038b9-456e-4165-9139-f89acc4aecd1. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Updating instance_info_cache with network_info: [{"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-42a63e2f-7005-4415-b863-6858d659cff0 req-db9a3333-4574-4fff-8b18-c40dbf3881be service nova] Releasing lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:26:52 user nova-compute[74131]: INFO nova.compute.claims [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Claim successful on node user
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:26:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.policy [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82534b86e314f00896042e2e684a623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097a2eccca244cbfa897e6a573a3113d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:26:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Creating image(s)
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "/opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.251s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.283s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk 1073741824" returned: 0 in 0.066s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-77428859-561b-403d-acbe-0a902ef57720 req-b32f6e82-a412-4991-bdb0-819112568d09 service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-77428859-561b-403d-acbe-0a902ef57720 req-b32f6e82-a412-4991-bdb0-819112568d09 service nova] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-77428859-561b-403d-acbe-0a902ef57720 req-b32f6e82-a412-4991-bdb0-819112568d09 service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-77428859-561b-403d-acbe-0a902ef57720 req-b32f6e82-a412-4991-bdb0-819112568d09 service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-77428859-561b-403d-acbe-0a902ef57720 req-b32f6e82-a412-4991-bdb0-819112568d09 service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] No waiting events found dispatching network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:54 user nova-compute[74131]: WARNING nova.compute.manager [req-77428859-561b-403d-acbe-0a902ef57720 req-b32f6e82-a412-4991-bdb0-819112568d09 service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received unexpected event network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 for instance with vm_state building and task_state spawning.
Oct 20 16:26:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Cannot resize image /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Ensure instance console log exists: /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Successfully created port: 1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:26:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Successfully updated port: 1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updating instance_info_cache with network_info: [{"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Instance network_info: |[{"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Start _get_guest_xml network_info=[{"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:26:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-667768035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-667768035',id=19,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-t3u0f8ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:26:53Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=562d3ea2-1242-44ef-938c-7e2113d46496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:4d,bridge_name='br-int',has_traffic_filtering=True,id=1ff6c710-c3ec-4e8a-871b-5fb62df7315b,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff6c710-c3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'pci_devices' on Instance uuid 562d3ea2-1242-44ef-938c-7e2113d46496 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:26:56 user nova-compute[74131]:   <uuid>562d3ea2-1242-44ef-938c-7e2113d46496</uuid>
Oct 20 16:26:56 user nova-compute[74131]:   <name>instance-00000013</name>
Oct 20 16:26:56 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:26:56 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:26:56 user nova-compute[74131]:   <metadata>
Oct 20 16:26:56 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:26:56 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:26:56 user nova-compute[74131]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-667768035</nova:name>
Oct 20 16:26:56 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:26:55</nova:creationTime>
Oct 20 16:26:56 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:26:56 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:26:56 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:26:56 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:26:56 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:26:56 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:26:56 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:26:56 user nova-compute[74131]:       <nova:owner>
Oct 20 16:26:56 user nova-compute[74131]:         <nova:user uuid="a82534b86e314f00896042e2e684a623">tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member</nova:user>
Oct 20 16:26:56 user nova-compute[74131]:         <nova:project uuid="097a2eccca244cbfa897e6a573a3113d">tempest-ServerBootFromVolumeStableRescueTest-131352591</nova:project>
Oct 20 16:26:56 user nova-compute[74131]:       </nova:owner>
Oct 20 16:26:56 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:26:56 user nova-compute[74131]:       <nova:ports>
Oct 20 16:26:56 user nova-compute[74131]:         <nova:port uuid="1ff6c710-c3ec-4e8a-871b-5fb62df7315b">
Oct 20 16:26:56 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 16:26:56 user nova-compute[74131]:         </nova:port>
Oct 20 16:26:56 user nova-compute[74131]:       </nova:ports>
Oct 20 16:26:56 user nova-compute[74131]:     </nova:instance>
Oct 20 16:26:56 user nova-compute[74131]:   </metadata>
Oct 20 16:26:56 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:26:56 user nova-compute[74131]:     <system>
Oct 20 16:26:56 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:26:56 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:26:56 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:26:56 user nova-compute[74131]:       <entry name="serial">562d3ea2-1242-44ef-938c-7e2113d46496</entry>
Oct 20 16:26:56 user nova-compute[74131]:       <entry name="uuid">562d3ea2-1242-44ef-938c-7e2113d46496</entry>
Oct 20 16:26:56 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:26:56 user nova-compute[74131]:     </system>
Oct 20 16:26:56 user nova-compute[74131]:   </sysinfo>
Oct 20 16:26:56 user nova-compute[74131]:   <os>
Oct 20 16:26:56 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:26:56 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:26:56 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:26:56 user nova-compute[74131]:   </os>
Oct 20 16:26:56 user nova-compute[74131]:   <features>
Oct 20 16:26:56 user nova-compute[74131]:     <acpi/>
Oct 20 16:26:56 user nova-compute[74131]:     <apic/>
Oct 20 16:26:56 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:26:56 user nova-compute[74131]:   </features>
Oct 20 16:26:56 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:26:56 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:26:56 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:26:56 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:26:56 user nova-compute[74131]:   </clock>
Oct 20 16:26:56 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:26:56 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:26:56 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:26:56 user nova-compute[74131]:   </cpu>
Oct 20 16:26:56 user nova-compute[74131]:   <devices>
Oct 20 16:26:56 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:26:56 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:26:56 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk"/>
Oct 20 16:26:56 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:26:56 user nova-compute[74131]:     </disk>
Oct 20 16:26:56 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:26:56 user nova-compute[74131]:       <mac address="fa:16:3e:87:30:4d"/>
Oct 20 16:26:56 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:26:56 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:26:56 user nova-compute[74131]:       <target dev="tap1ff6c710-c3"/>
Oct 20 16:26:56 user nova-compute[74131]:     </interface>
Oct 20 16:26:56 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:26:56 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/console.log" append="off"/>
Oct 20 16:26:56 user nova-compute[74131]:     </serial>
Oct 20 16:26:56 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:26:56 user nova-compute[74131]:     <video>
Oct 20 16:26:56 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:26:56 user nova-compute[74131]:     </video>
Oct 20 16:26:56 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:26:56 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:26:56 user nova-compute[74131]:     </rng>
Oct 20 16:26:56 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:26:56 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:26:56 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:26:56 user nova-compute[74131]:     </memballoon>
Oct 20 16:26:56 user nova-compute[74131]:   </devices>
Oct 20 16:26:56 user nova-compute[74131]: </domain>
Oct 20 16:26:56 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-667768035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-667768035',id=19,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-t3u0f8ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:26:53Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=562d3ea2-1242-44ef-938c-7e2113d46496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:4d,bridge_name='br-int',has_traffic_filtering=True,id=1ff6c710-c3ec-4e8a-871b-5fb62df7315b,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff6c710-c3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG os_vif [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:4d,bridge_name='br-int',has_traffic_filtering=True,id=1ff6c710-c3ec-4e8a-871b-5fb62df7315b,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff6c710-c3') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef76518d-c0e9-5ba5-837c-62f45019e65f', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ff6c710-c3, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ff6c710-c3, col_values=(('qos', UUID('1e6cbdb1-8cdb-4200-92db-9e31f3fbdf12')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ff6c710-c3, col_values=(('external_ids', {'iface-id': '1ff6c710-c3ec-4e8a-871b-5fb62df7315b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:30:4d', 'vm-uuid': '562d3ea2-1242-44ef-938c-7e2113d46496'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:56 user nova-compute[74131]: INFO os_vif [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:4d,bridge_name='br-int',has_traffic_filtering=True,id=1ff6c710-c3ec-4e8a-871b-5fb62df7315b,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff6c710-c3')
Oct 20 16:26:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] No waiting events found dispatching network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:56 user nova-compute[74131]: WARNING nova.compute.manager [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received unexpected event network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 for instance with vm_state building and task_state spawning.
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received event network-changed-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Refreshing instance network info cache due to event network-changed-1ff6c710-c3ec-4e8a-871b-5fb62df7315b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] Acquiring lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] Acquired lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Refreshing network info cache for port 1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:26:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Instance spawned successfully.
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No VIF found with MAC fa:16:3e:87:30:4d, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:26:56 user nova-compute[74131]: INFO nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Took 7.63 seconds to spawn the instance on the hypervisor.
Oct 20 16:26:56 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:26:56 user nova-compute[74131]: INFO nova.compute.manager [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Took 8.54 seconds to build instance.
Oct 20 16:26:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f24b8ad0-2c59-4415-8efb-6c5dec3dc23d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.706s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updated VIF entry in instance network info cache for port 1ff6c710-c3ec-4e8a-871b-5fb62df7315b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:26:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updating instance_info_cache with network_info: [{"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:26:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3c5c78bb-a454-4316-a88c-2b0de33958ba req-916de2ef-dd86-4f9e-80ca-49f3015d7a8e service nova] Releasing lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-82268c97-46fa-4bc8-86dc-a0f17b67195c req-73db87ab-4558-4e95-b343-ef9edd6d57c8 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received event network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-82268c97-46fa-4bc8-86dc-a0f17b67195c req-73db87ab-4558-4e95-b343-ef9edd6d57c8 service nova] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-82268c97-46fa-4bc8-86dc-a0f17b67195c req-73db87ab-4558-4e95-b343-ef9edd6d57c8 service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-82268c97-46fa-4bc8-86dc-a0f17b67195c req-73db87ab-4558-4e95-b343-ef9edd6d57c8 service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-82268c97-46fa-4bc8-86dc-a0f17b67195c req-73db87ab-4558-4e95-b343-ef9edd6d57c8 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] No waiting events found dispatching network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:26:58 user nova-compute[74131]: WARNING nova.compute.manager [req-82268c97-46fa-4bc8-86dc-a0f17b67195c req-73db87ab-4558-4e95-b343-ef9edd6d57c8 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received unexpected event network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b for instance with vm_state building and task_state spawning.
Oct 20 16:26:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:26:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-a8bd658c-5383-458c-96fa-71b8208a5a00 req-e59125f6-6529-4543-9dd3-1d9979cf22dc service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received event network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a8bd658c-5383-458c-96fa-71b8208a5a00 req-e59125f6-6529-4543-9dd3-1d9979cf22dc service nova] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a8bd658c-5383-458c-96fa-71b8208a5a00 req-e59125f6-6529-4543-9dd3-1d9979cf22dc service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a8bd658c-5383-458c-96fa-71b8208a5a00 req-e59125f6-6529-4543-9dd3-1d9979cf22dc service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-a8bd658c-5383-458c-96fa-71b8208a5a00 req-e59125f6-6529-4543-9dd3-1d9979cf22dc service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] No waiting events found dispatching network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:00 user nova-compute[74131]: WARNING nova.compute.manager [req-a8bd658c-5383-458c-96fa-71b8208a5a00 req-e59125f6-6529-4543-9dd3-1d9979cf22dc service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received unexpected event network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b for instance with vm_state building and task_state spawning.
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:27:00 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Instance spawned successfully.
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:00 user nova-compute[74131]: INFO nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Took 7.41 seconds to spawn the instance on the hypervisor.
Oct 20 16:27:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:27:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:01 user nova-compute[74131]: INFO nova.compute.manager [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Took 8.26 seconds to build instance.
Oct 20 16:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ab936d-ae79-41cc-a211-c20d8ca48a65 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.415s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:27:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:27:07 user nova-compute[74131]: INFO nova.compute.claims [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Claim successful on node user
Oct 20 16:27:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:08 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:27:08 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:27:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:27:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:27:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:27:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:27:08 user nova-compute[74131]: DEBUG nova.policy [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79db1d105a6e406a965eb94987fdfaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac73a0c54fb4583aec623c4c7528428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:27:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:27:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Creating image(s)
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk 1073741824" returned: 0 in 0.069s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Successfully created port: 7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:27:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Cannot resize image /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Ensure instance console log exists: /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Successfully updated port: 7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquired lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-changed-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Refreshing instance network info cache due to event network-changed-7a8f5260-8511-466c-b422-3e6156d8b3cc. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] Acquiring lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:10 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updating instance_info_cache with network_info: [{"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Releasing lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Instance network_info: |[{"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] Acquired lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.network.neutron [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Refreshing network info cache for port 7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Start _get_guest_xml network_info=[{"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:27:11 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:27:11 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1043008733',display_name='tempest-AttachVolumeNegativeTest-server-1043008733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1043008733',id=20,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvINOuU21efj8A/0FLSAwLVIcuzoshiC1Rnbfodz+qRAcfz8jlIneA/3vNKlD8CyYe1Wc0fjdfcNmJZRqWqfEoTKCHyQL6BqeHuZbg8XB01UFrGqjlhfz0wlzmlFy4+Hw==',key_name='tempest-keypair-578989018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-3ue8pwog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=4b745a18-2505-4af6-874f-c09de7cdad2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:34,bridge_name='br-int',has_traffic_filtering=True,id=7a8f5260-8511-466c-b422-3e6156d8b3cc,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8f5260-85') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b745a18-2505-4af6-874f-c09de7cdad2c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:27:11 user nova-compute[74131]:   <uuid>4b745a18-2505-4af6-874f-c09de7cdad2c</uuid>
Oct 20 16:27:11 user nova-compute[74131]:   <name>instance-00000014</name>
Oct 20 16:27:11 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:27:11 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:27:11 user nova-compute[74131]:   <metadata>
Oct 20 16:27:11 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:27:11 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:27:11 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1043008733</nova:name>
Oct 20 16:27:11 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:27:11</nova:creationTime>
Oct 20 16:27:11 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:27:11 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:27:11 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:27:11 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:27:11 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:27:11 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:27:11 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:27:11 user nova-compute[74131]:       <nova:owner>
Oct 20 16:27:11 user nova-compute[74131]:         <nova:user uuid="79db1d105a6e406a965eb94987fdfaf3">tempest-AttachVolumeNegativeTest-395634699-project-member</nova:user>
Oct 20 16:27:11 user nova-compute[74131]:         <nova:project uuid="3ac73a0c54fb4583aec623c4c7528428">tempest-AttachVolumeNegativeTest-395634699</nova:project>
Oct 20 16:27:11 user nova-compute[74131]:       </nova:owner>
Oct 20 16:27:11 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:27:11 user nova-compute[74131]:       <nova:ports>
Oct 20 16:27:11 user nova-compute[74131]:         <nova:port uuid="7a8f5260-8511-466c-b422-3e6156d8b3cc">
Oct 20 16:27:11 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 16:27:11 user nova-compute[74131]:         </nova:port>
Oct 20 16:27:11 user nova-compute[74131]:       </nova:ports>
Oct 20 16:27:11 user nova-compute[74131]:     </nova:instance>
Oct 20 16:27:11 user nova-compute[74131]:   </metadata>
Oct 20 16:27:11 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:27:11 user nova-compute[74131]:     <system>
Oct 20 16:27:11 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:27:11 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:27:11 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:27:11 user nova-compute[74131]:       <entry name="serial">4b745a18-2505-4af6-874f-c09de7cdad2c</entry>
Oct 20 16:27:11 user nova-compute[74131]:       <entry name="uuid">4b745a18-2505-4af6-874f-c09de7cdad2c</entry>
Oct 20 16:27:11 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:27:11 user nova-compute[74131]:     </system>
Oct 20 16:27:11 user nova-compute[74131]:   </sysinfo>
Oct 20 16:27:11 user nova-compute[74131]:   <os>
Oct 20 16:27:11 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:27:11 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:27:11 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:27:11 user nova-compute[74131]:   </os>
Oct 20 16:27:11 user nova-compute[74131]:   <features>
Oct 20 16:27:11 user nova-compute[74131]:     <acpi/>
Oct 20 16:27:11 user nova-compute[74131]:     <apic/>
Oct 20 16:27:11 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:27:11 user nova-compute[74131]:   </features>
Oct 20 16:27:11 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:27:11 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:27:11 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:27:11 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:27:11 user nova-compute[74131]:   </clock>
Oct 20 16:27:11 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:27:11 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:27:11 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:27:11 user nova-compute[74131]:   </cpu>
Oct 20 16:27:11 user nova-compute[74131]:   <devices>
Oct 20 16:27:11 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:27:11 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:27:11 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk"/>
Oct 20 16:27:11 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:27:11 user nova-compute[74131]:     </disk>
Oct 20 16:27:11 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:27:11 user nova-compute[74131]:       <mac address="fa:16:3e:42:82:34"/>
Oct 20 16:27:11 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:27:11 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:27:11 user nova-compute[74131]:       <target dev="tap7a8f5260-85"/>
Oct 20 16:27:11 user nova-compute[74131]:     </interface>
Oct 20 16:27:11 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:27:11 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/console.log" append="off"/>
Oct 20 16:27:11 user nova-compute[74131]:     </serial>
Oct 20 16:27:11 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:27:11 user nova-compute[74131]:     <video>
Oct 20 16:27:11 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:27:11 user nova-compute[74131]:     </video>
Oct 20 16:27:11 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:27:11 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:27:11 user nova-compute[74131]:     </rng>
Oct 20 16:27:11 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:27:11 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:27:11 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:27:11 user nova-compute[74131]:     </memballoon>
Oct 20 16:27:11 user nova-compute[74131]:   </devices>
Oct 20 16:27:11 user nova-compute[74131]: </domain>
Oct 20 16:27:11 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1043008733',display_name='tempest-AttachVolumeNegativeTest-server-1043008733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1043008733',id=20,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvINOuU21efj8A/0FLSAwLVIcuzoshiC1Rnbfodz+qRAcfz8jlIneA/3vNKlD8CyYe1Wc0fjdfcNmJZRqWqfEoTKCHyQL6BqeHuZbg8XB01UFrGqjlhfz0wlzmlFy4+Hw==',key_name='tempest-keypair-578989018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-3ue8pwog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=4b745a18-2505-4af6-874f-c09de7cdad2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:34,bridge_name='br-int',has_traffic_filtering=True,id=7a8f5260-8511-466c-b422-3e6156d8b3cc,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8f5260-85') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG os_vif [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:34,bridge_name='br-int',has_traffic_filtering=True,id=7a8f5260-8511-466c-b422-3e6156d8b3cc,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8f5260-85') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19724ec5-2dd5-5e3f-ad19-a25eeeecb76d', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a8f5260-85, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a8f5260-85, col_values=(('qos', UUID('10806012-d74c-4a26-a0d1-2761f92c591a')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a8f5260-85, col_values=(('external_ids', {'iface-id': '7a8f5260-8511-466c-b422-3e6156d8b3cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:82:34', 'vm-uuid': '4b745a18-2505-4af6-874f-c09de7cdad2c'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: INFO os_vif [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:34,bridge_name='br-int',has_traffic_filtering=True,id=7a8f5260-8511-466c-b422-3e6156d8b3cc,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8f5260-85')
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No VIF found with MAC fa:16:3e:42:82:34, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "0c360989-4303-456b-af5d-bb341e654098" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "0c360989-4303-456b-af5d-bb341e654098-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "0c360989-4303-456b-af5d-bb341e654098-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:11 user nova-compute[74131]: INFO nova.compute.manager [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Terminating instance
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:11 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:27:11 user nova-compute[74131]: INFO nova.compute.claims [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Claim successful on node user
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.network.neutron [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updated VIF entry in instance network info cache for port 7a8f5260-8511-466c-b422-3e6156d8b3cc. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.network.neutron [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updating instance_info_cache with network_info: [{"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9cb9d41d-81d3-4ee0-ae87-328114914f49 req-77cd2992-debd-4ec2-9681-66c613384e13 service nova] Releasing lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:27:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 0c360989-4303-456b-af5d-bb341e654098] Instance destroyed successfully.
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lazy-loading 'resources' on Instance uuid 0c360989-4303-456b-af5d-bb341e654098 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-472323587',display_name='tempest-ServersNegativeTestJSON-server-472323587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-472323587',id=14,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:25:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5bc52c1d965465687699b8e0118300b',ramdisk_id='',reservation_id='r-9vnlqrzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-270953747',owner_user_name='tempest-ServersNegativeTestJSON-270953747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:25:31Z,user_data=None,user_id='757415037269406cbc1dfe3de4465c53',uuid=0c360989-4303-456b-af5d-bb341e654098,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converting VIF {"id": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "address": "fa:16:3e:6c:64:42", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc90be11-bf", "ovs_interfaceid": "cc90be11-bf51-4fdb-a1a8-96f13ee53544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:64:42,bridge_name='br-int',has_traffic_filtering=True,id=cc90be11-bf51-4fdb-a1a8-96f13ee53544,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc90be11-bf') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG os_vif [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:64:42,bridge_name='br-int',has_traffic_filtering=True,id=cc90be11-bf51-4fdb-a1a8-96f13ee53544,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc90be11-bf') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc90be11-bf, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:27:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4aabf6dd-e595-4f7b-8ccf-28713a95615c) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:12 user nova-compute[74131]: INFO os_vif [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:64:42,bridge_name='br-int',has_traffic_filtering=True,id=cc90be11-bf51-4fdb-a1a8-96f13ee53544,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc90be11-bf')
Oct 20 16:27:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Deleting instance files /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098_del
Oct 20 16:27:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Deletion of /opt/stack/data/nova/instances/0c360989-4303-456b-af5d-bb341e654098_del complete
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-5c07ec04-511e-409c-a870-2a722da0a97f req-c15a22d2-ca48-426f-858c-bc8792733cf5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received event network-vif-unplugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5c07ec04-511e-409c-a870-2a722da0a97f req-c15a22d2-ca48-426f-858c-bc8792733cf5 service nova] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5c07ec04-511e-409c-a870-2a722da0a97f req-c15a22d2-ca48-426f-858c-bc8792733cf5 service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5c07ec04-511e-409c-a870-2a722da0a97f req-c15a22d2-ca48-426f-858c-bc8792733cf5 service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-5c07ec04-511e-409c-a870-2a722da0a97f req-c15a22d2-ca48-426f-858c-bc8792733cf5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] No waiting events found dispatching network-vif-unplugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-5c07ec04-511e-409c-a870-2a722da0a97f req-c15a22d2-ca48-426f-858c-bc8792733cf5 service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received event network-vif-unplugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:27:12 user nova-compute[74131]: INFO nova.compute.manager [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 0c360989-4303-456b-af5d-bb341e654098] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 20 16:27:12 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 0c360989-4303-456b-af5d-bb341e654098] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 0c360989-4303-456b-af5d-bb341e654098] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:27:12 user nova-compute[74131]: DEBUG nova.policy [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27db8d4c54ec453b95a9a0de35d18fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfddd1bd2cd4dde9c2fede4e4d6aa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:27:13 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Creating image(s)
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "/opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "/opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.222s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.284s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk 1073741824" returned: 0 in 0.090s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 0c360989-4303-456b-af5d-bb341e654098] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:13 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 0c360989-4303-456b-af5d-bb341e654098] Took 0.98 seconds to deallocate network for instance.
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.320s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:27:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.006s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Cannot resize image /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Ensure instance console log exists: /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-4770565c-5a0d-45f5-937e-0f0eb789eef1 req-1f5a5743-21a2-43ca-a2f3-d2f92da9dffb service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4770565c-5a0d-45f5-937e-0f0eb789eef1 req-1f5a5743-21a2-43ca-a2f3-d2f92da9dffb service nova] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4770565c-5a0d-45f5-937e-0f0eb789eef1 req-1f5a5743-21a2-43ca-a2f3-d2f92da9dffb service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4770565c-5a0d-45f5-937e-0f0eb789eef1 req-1f5a5743-21a2-43ca-a2f3-d2f92da9dffb service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-4770565c-5a0d-45f5-937e-0f0eb789eef1 req-1f5a5743-21a2-43ca-a2f3-d2f92da9dffb service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] No waiting events found dispatching network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:14 user nova-compute[74131]: WARNING nova.compute.manager [req-4770565c-5a0d-45f5-937e-0f0eb789eef1 req-1f5a5743-21a2-43ca-a2f3-d2f92da9dffb service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received unexpected event network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc for instance with vm_state building and task_state spawning.
Oct 20 16:27:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Successfully created port: 63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:14 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Deleted allocations for instance 0c360989-4303-456b-af5d-bb341e654098
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b1f055f9-7ead-40c3-8d7a-066bf0097a44 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "0c360989-4303-456b-af5d-bb341e654098" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9702438-80c0-459b-bed1-6b2b36ba547c req-a8d7e3a6-b165-467b-810a-89f1e97685af service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received event network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9702438-80c0-459b-bed1-6b2b36ba547c req-a8d7e3a6-b165-467b-810a-89f1e97685af service nova] Acquiring lock "0c360989-4303-456b-af5d-bb341e654098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9702438-80c0-459b-bed1-6b2b36ba547c req-a8d7e3a6-b165-467b-810a-89f1e97685af service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9702438-80c0-459b-bed1-6b2b36ba547c req-a8d7e3a6-b165-467b-810a-89f1e97685af service nova] Lock "0c360989-4303-456b-af5d-bb341e654098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9702438-80c0-459b-bed1-6b2b36ba547c req-a8d7e3a6-b165-467b-810a-89f1e97685af service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] No waiting events found dispatching network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:15 user nova-compute[74131]: WARNING nova.compute.manager [req-c9702438-80c0-459b-bed1-6b2b36ba547c req-a8d7e3a6-b165-467b-810a-89f1e97685af service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received unexpected event network-vif-plugged-cc90be11-bf51-4fdb-a1a8-96f13ee53544 for instance with vm_state deleted and task_state None.
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9702438-80c0-459b-bed1-6b2b36ba547c req-a8d7e3a6-b165-467b-810a-89f1e97685af service nova] [instance: 0c360989-4303-456b-af5d-bb341e654098] Received event network-vif-deleted-cc90be11-bf51-4fdb-a1a8-96f13ee53544 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Successfully updated port: 63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquired lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updating instance_info_cache with network_info: [{"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Releasing lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Instance network_info: |[{"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Start _get_guest_xml network_info=[{"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:27:15 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:27:15 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:27:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1824514671',display_name='tempest-VolumesAdminNegativeTest-server-1824514671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1824514671',id=21,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKd3Ykv1OyUkCOokuVnAflB+CLmZ+tO3CxGHUEShH0odlbivMQR9avsmoQnysyZk3HXIYWN+6jBgGamj5vr5AAXZsUdkx7PzIJGVNEz+jz7jrWSbi5c70ZOTfC+S4i1Sg==',key_name='tempest-keypair-2091384900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dfddd1bd2cd4dde9c2fede4e4d6aa00',ramdisk_id='',reservation_id='r-cl3bouv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-651596449',owner_user_name='tempest-VolumesAdminNegativeTest-651596449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27db8d4c54ec453b95a9a0de35d18fe3',uuid=5e111d85-bd8d-40b4-b664-8ab924063cb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converting VIF {"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:b0,bridge_name='br-int',has_traffic_filtering=True,id=63aa31e1-90f1-4666-8afa-aa2333595208,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63aa31e1-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e111d85-bd8d-40b4-b664-8ab924063cb6 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:27:16 user nova-compute[74131]:   <uuid>5e111d85-bd8d-40b4-b664-8ab924063cb6</uuid>
Oct 20 16:27:16 user nova-compute[74131]:   <name>instance-00000015</name>
Oct 20 16:27:16 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:27:16 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:27:16 user nova-compute[74131]:   <metadata>
Oct 20 16:27:16 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:27:16 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:27:16 user nova-compute[74131]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1824514671</nova:name>
Oct 20 16:27:16 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:27:15</nova:creationTime>
Oct 20 16:27:16 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:27:16 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:27:16 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:27:16 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:27:16 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:27:16 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:27:16 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:27:16 user nova-compute[74131]:       <nova:owner>
Oct 20 16:27:16 user nova-compute[74131]:         <nova:user uuid="27db8d4c54ec453b95a9a0de35d18fe3">tempest-VolumesAdminNegativeTest-651596449-project-member</nova:user>
Oct 20 16:27:16 user nova-compute[74131]:         <nova:project uuid="4dfddd1bd2cd4dde9c2fede4e4d6aa00">tempest-VolumesAdminNegativeTest-651596449</nova:project>
Oct 20 16:27:16 user nova-compute[74131]:       </nova:owner>
Oct 20 16:27:16 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:27:16 user nova-compute[74131]:       <nova:ports>
Oct 20 16:27:16 user nova-compute[74131]:         <nova:port uuid="63aa31e1-90f1-4666-8afa-aa2333595208">
Oct 20 16:27:16 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:27:16 user nova-compute[74131]:         </nova:port>
Oct 20 16:27:16 user nova-compute[74131]:       </nova:ports>
Oct 20 16:27:16 user nova-compute[74131]:     </nova:instance>
Oct 20 16:27:16 user nova-compute[74131]:   </metadata>
Oct 20 16:27:16 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:27:16 user nova-compute[74131]:     <system>
Oct 20 16:27:16 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:27:16 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:27:16 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:27:16 user nova-compute[74131]:       <entry name="serial">5e111d85-bd8d-40b4-b664-8ab924063cb6</entry>
Oct 20 16:27:16 user nova-compute[74131]:       <entry name="uuid">5e111d85-bd8d-40b4-b664-8ab924063cb6</entry>
Oct 20 16:27:16 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:27:16 user nova-compute[74131]:     </system>
Oct 20 16:27:16 user nova-compute[74131]:   </sysinfo>
Oct 20 16:27:16 user nova-compute[74131]:   <os>
Oct 20 16:27:16 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:27:16 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:27:16 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:27:16 user nova-compute[74131]:   </os>
Oct 20 16:27:16 user nova-compute[74131]:   <features>
Oct 20 16:27:16 user nova-compute[74131]:     <acpi/>
Oct 20 16:27:16 user nova-compute[74131]:     <apic/>
Oct 20 16:27:16 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:27:16 user nova-compute[74131]:   </features>
Oct 20 16:27:16 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:27:16 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:27:16 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:27:16 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:27:16 user nova-compute[74131]:   </clock>
Oct 20 16:27:16 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:27:16 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:27:16 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:27:16 user nova-compute[74131]:   </cpu>
Oct 20 16:27:16 user nova-compute[74131]:   <devices>
Oct 20 16:27:16 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:27:16 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:27:16 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk"/>
Oct 20 16:27:16 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:27:16 user nova-compute[74131]:     </disk>
Oct 20 16:27:16 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:27:16 user nova-compute[74131]:       <mac address="fa:16:3e:5f:ff:b0"/>
Oct 20 16:27:16 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:27:16 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:27:16 user nova-compute[74131]:       <target dev="tap63aa31e1-90"/>
Oct 20 16:27:16 user nova-compute[74131]:     </interface>
Oct 20 16:27:16 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:27:16 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/console.log" append="off"/>
Oct 20 16:27:16 user nova-compute[74131]:     </serial>
Oct 20 16:27:16 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:27:16 user nova-compute[74131]:     <video>
Oct 20 16:27:16 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:27:16 user nova-compute[74131]:     </video>
Oct 20 16:27:16 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:27:16 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:27:16 user nova-compute[74131]:     </rng>
Oct 20 16:27:16 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:27:16 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:27:16 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:27:16 user nova-compute[74131]:     </memballoon>
Oct 20 16:27:16 user nova-compute[74131]:   </devices>
Oct 20 16:27:16 user nova-compute[74131]: </domain>
Oct 20 16:27:16 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1824514671',display_name='tempest-VolumesAdminNegativeTest-server-1824514671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1824514671',id=21,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKd3Ykv1OyUkCOokuVnAflB+CLmZ+tO3CxGHUEShH0odlbivMQR9avsmoQnysyZk3HXIYWN+6jBgGamj5vr5AAXZsUdkx7PzIJGVNEz+jz7jrWSbi5c70ZOTfC+S4i1Sg==',key_name='tempest-keypair-2091384900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dfddd1bd2cd4dde9c2fede4e4d6aa00',ramdisk_id='',reservation_id='r-cl3bouv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-651596449',owner_user_name='tempest-VolumesAdminNegativeTest-651596449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27db8d4c54ec453b95a9a0de35d18fe3',uuid=5e111d85-bd8d-40b4-b664-8ab924063cb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converting VIF {"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:b0,bridge_name='br-int',has_traffic_filtering=True,id=63aa31e1-90f1-4666-8afa-aa2333595208,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63aa31e1-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG os_vif [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:b0,bridge_name='br-int',has_traffic_filtering=True,id=63aa31e1-90f1-4666-8afa-aa2333595208,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63aa31e1-90') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4c64b65-4968-5134-af17-fdde7a86b23b', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63aa31e1-90, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63aa31e1-90, col_values=(('qos', UUID('57c8dd0a-eb2e-4f89-aab6-d51e1858ba85')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63aa31e1-90, col_values=(('external_ids', {'iface-id': '63aa31e1-90f1-4666-8afa-aa2333595208', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:ff:b0', 'vm-uuid': '5e111d85-bd8d-40b4-b664-8ab924063cb6'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:16 user nova-compute[74131]: INFO os_vif [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:b0,bridge_name='br-int',has_traffic_filtering=True,id=63aa31e1-90f1-4666-8afa-aa2333595208,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63aa31e1-90')
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] No VIF found with MAC fa:16:3e:5f:ff:b0, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] No waiting events found dispatching network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:16 user nova-compute[74131]: WARNING nova.compute.manager [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received unexpected event network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc for instance with vm_state building and task_state spawning.
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-changed-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Refreshing instance network info cache due to event network-changed-63aa31e1-90f1-4666-8afa-aa2333595208. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] Acquiring lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] Acquired lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.network.neutron [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Refreshing network info cache for port 63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:27:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Instance spawned successfully.
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:16 user nova-compute[74131]: INFO nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Took 7.47 seconds to spawn the instance on the hypervisor.
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:27:16 user nova-compute[74131]: INFO nova.compute.manager [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Took 8.86 seconds to build instance.
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b9fdca13-3b5b-4252-8d1b-13112ebc6cd3 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.058s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.network.neutron [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updated VIF entry in instance network info cache for port 63aa31e1-90f1-4666-8afa-aa2333595208. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG nova.network.neutron [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updating instance_info_cache with network_info: [{"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c564fade-7b7f-4b70-be90-e576f7cdddb3 req-927fca38-d8f5-4401-a672-f7d3b8938e59 service nova] Releasing lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] No waiting events found dispatching network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:18 user nova-compute[74131]: WARNING nova.compute.manager [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received unexpected event network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 for instance with vm_state building and task_state spawning.
Oct 20 16:27:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] No waiting events found dispatching network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:18 user nova-compute[74131]: WARNING nova.compute.manager [req-5a91ba49-bec5-4f93-916e-ed5b1e42023c req-1d40a6ac-c75e-42b3-9971-a6682762b23c service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received unexpected event network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 for instance with vm_state building and task_state spawning.
Oct 20 16:27:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Skipping network cache update for instance because it is Building. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:27:19 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 151335d8-e828-425b-8422-ba047749b204 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Updating instance_info_cache with network_info: [{"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:27:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Instance spawned successfully.
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:27:20 user nova-compute[74131]: INFO nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Took 7.62 seconds to spawn the instance on the hypervisor.
Oct 20 16:27:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:20 user nova-compute[74131]: INFO nova.compute.manager [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Took 8.89 seconds to build instance.
Oct 20 16:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a8d06de7-ff26-4d36-bf4c-803ecf12b56b tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.107s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-changed-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Refreshing instance network info cache due to event network-changed-ed1b4ad7-52eb-432e-877f-4430254707c3. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] Acquiring lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] Acquired lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Refreshing network info cache for port ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updated VIF entry in instance network info cache for port ed1b4ad7-52eb-432e-877f-4430254707c3. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-58b9dbcb-8e31-4acc-9d18-3462ef7177f3 req-ddb7ef3a-f83a-4f48-885b-b65bda3fc1ae service nova] Releasing lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing instance network info cache due to event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] Acquiring lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] Acquired lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:27:25 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:27:25 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=25.517108917236328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 52b4f002-76fb-45c7-8b60-25c56d40740c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9aee3d08-7204-4215-9e6a-0d52766749f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4b745a18-2505-4af6-874f-c09de7cdad2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:27:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updated VIF entry in instance network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-71d3792a-ecf5-42a2-be95-48ef8553b52e req-dfdf278b-8d6b-4bec-943c-c16ba1236ea4 service nova] Releasing lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:27:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:32 user nova-compute[74131]: INFO nova.compute.manager [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Shelving
Oct 20 16:27:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-b107af02-a833-41a4-b3f3-0b60b28aed17 req-00c37c37-7853-41c4-83eb-13c39371b576 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-unplugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b107af02-a833-41a4-b3f3-0b60b28aed17 req-00c37c37-7853-41c4-83eb-13c39371b576 service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b107af02-a833-41a4-b3f3-0b60b28aed17 req-00c37c37-7853-41c4-83eb-13c39371b576 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b107af02-a833-41a4-b3f3-0b60b28aed17 req-00c37c37-7853-41c4-83eb-13c39371b576 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-b107af02-a833-41a4-b3f3-0b60b28aed17 req-00c37c37-7853-41c4-83eb-13c39371b576 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-unplugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:33 user nova-compute[74131]: WARNING nova.compute.manager [req-b107af02-a833-41a4-b3f3-0b60b28aed17 req-00c37c37-7853-41c4-83eb-13c39371b576 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received unexpected event network-vif-unplugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with vm_state active and task_state shelving.
Oct 20 16:27:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance destroyed successfully.
Oct 20 16:27:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Beginning cold snapshot process
Oct 20 16:27:34 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:27:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk /opt/stack/data/nova/instances/snapshots/tmpog8eibid/a031bbb46e204050bc075d88dca0eed6 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:27:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk /opt/stack/data/nova/instances/snapshots/tmpog8eibid/a031bbb46e204050bc075d88dca0eed6" returned: 0 in 0.802s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:27:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Snapshot extracted, beginning image upload
Oct 20 16:27:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-f2b6d443-bdc9-4d8a-af81-8cf8acb4cd84 req-5aa614d7-c169-471f-ac62-db19604fb960 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f2b6d443-bdc9-4d8a-af81-8cf8acb4cd84 req-5aa614d7-c169-471f-ac62-db19604fb960 service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f2b6d443-bdc9-4d8a-af81-8cf8acb4cd84 req-5aa614d7-c169-471f-ac62-db19604fb960 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f2b6d443-bdc9-4d8a-af81-8cf8acb4cd84 req-5aa614d7-c169-471f-ac62-db19604fb960 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-f2b6d443-bdc9-4d8a-af81-8cf8acb4cd84 req-5aa614d7-c169-471f-ac62-db19604fb960 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:27:35 user nova-compute[74131]: WARNING nova.compute.manager [req-f2b6d443-bdc9-4d8a-af81-8cf8acb4cd84 req-5aa614d7-c169-471f-ac62-db19604fb960 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received unexpected event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 16:27:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Snapshot image upload complete
Oct 20 16:27:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:27:37 user nova-compute[74131]: INFO nova.compute.manager [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Shelve offloading
Oct 20 16:27:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance destroyed successfully.
Oct 20 16:27:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:27:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquired lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:27:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Releasing lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:39 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance destroyed successfully.
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'resources' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-976985580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-976985580',id=16,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVp9HZPyBmzXnZTVreymlvmqKM0FHfm/W5XKKYwI1AtVnw/zg7hXFbiOVKCYyHrV1fysjXPYeiMHX8blrvhaCQIboEP/l4Knd5znTivp0fMjMxKFUiZ2PARnMXKugz+iw==',key_name='tempest-keypair-1923835951',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-qaz16zij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member',shelved_at='2023-10-20T16:27:37.874521',shelved_host='user',shelved_image_id='9cb9dfeb-0090-471e-9a69-54cd69c9bd33'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=52b4f002-76fb-45c7-8b60-25c56d40740c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG os_vif [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b904706-24, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing instance network info cache due to event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] Acquiring lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] Acquired lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c53db6e-df76-43c3-b355-a0c44ed2b245) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:27:39 user nova-compute[74131]: INFO os_vif [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24')
Oct 20 16:27:39 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Deleting instance files /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c_del
Oct 20 16:27:39 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Deletion of /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c_del complete
Oct 20 16:27:39 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Deleted allocations for instance 52b4f002-76fb-45c7-8b60-25c56d40740c
Oct 20 16:27:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'numa_topology' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.objects.base [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<52b4f002-76fb-45c7-8b60-25c56d40740c> lazy-loaded attributes: resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updated VIF entry in instance network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6b904706-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-854fd580-edd6-4159-941b-1886d827a1a5 req-7149507c-4e55-47a9-a881-a98d579f6705 service nova] Releasing lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:27:39 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:27:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5628e01-aa84-4f8a-99a0-675729bc1035 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.132s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:27:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:27:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:28:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:28:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:28:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:28:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:28:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:28:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:28:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:28:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:28:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:28:19 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:28:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:23 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:28:23 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=25.424968719482422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9aee3d08-7204-4215-9e6a-0d52766749f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4b745a18-2505-4af6-874f-c09de7cdad2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:28:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:28:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:28:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:28:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:28:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:28:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:28:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:28:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:28:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:28:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:28:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:28:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing instance network info cache due to event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:28:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:28:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:28:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:28:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updated VIF entry in instance network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:28:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37918d45-6087-470f-88ae-947acba45622 req-514976c7-4bb1-420a-abd2-52ab1df6a0fb service nova] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:28:34 user nova-compute[74131]: INFO nova.compute.manager [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] instance snapshotting
Oct 20 16:28:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:28:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Beginning live snapshot process
Oct 20 16:28:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json -f qcow2" returned: 0 in 0.217s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdedf5l07/2f3270b19e7b4816b4c67baa21346618.delta 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdedf5l07/2f3270b19e7b4816b4c67baa21346618.delta 1073741824" returned: 0 in 0.050s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:35 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 16:28:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:28:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:28:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 16:28:36 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:28:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdedf5l07/2f3270b19e7b4816b4c67baa21346618.delta /opt/stack/data/nova/instances/snapshots/tmpdedf5l07/2f3270b19e7b4816b4c67baa21346618 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdedf5l07/2f3270b19e7b4816b4c67baa21346618.delta /opt/stack/data/nova/instances/snapshots/tmpdedf5l07/2f3270b19e7b4816b4c67baa21346618" returned: 0 in 0.392s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Snapshot extracted, beginning image upload
Oct 20 16:28:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-changed-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Refreshing instance network info cache due to event network-changed-b01038b9-456e-4165-9139-f89acc4aecd1. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] Acquiring lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] Acquired lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Refreshing network info cache for port b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Updated VIF entry in instance network info cache for port b01038b9-456e-4165-9139-f89acc4aecd1. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Updating instance_info_cache with network_info: [{"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f087ced9-f62c-4975-bc73-2afa7ec26253 req-a6eb8cd5-a3d2-458a-847c-1ed448ee88ac service nova] Releasing lock "refresh_cache-9aee3d08-7204-4215-9e6a-0d52766749f5" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:28:40 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Snapshot image upload complete
Oct 20 16:28:40 user nova-compute[74131]: INFO nova.compute.manager [None req-3dbe9ceb-9bb6-4b1a-b053-6dae0b2686e4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Took 6.44 seconds to snapshot the instance on the hypervisor.
Oct 20 16:28:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:28:43 user nova-compute[74131]: INFO nova.compute.manager [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] instance snapshotting
Oct 20 16:28:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Beginning live snapshot process
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.217s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmsiivj24/f36e999e611643c49cb9d8441e71e2cf.delta 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmsiivj24/f36e999e611643c49cb9d8441e71e2cf.delta 1073741824" returned: 0 in 0.059s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 16:28:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:28:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:28:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:28:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lazy-loading 'flavor' on Instance uuid 9aee3d08-7204-4215-9e6a-0d52766749f5 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:28:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.144s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:28:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:28:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:28:45 user nova-compute[74131]: INFO nova.compute.manager [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Attaching volume 0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed to /dev/vdb
Oct 20 16:28:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:28:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 16:28:46 user nova-compute[74131]: DEBUG os_brick.utils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea8d61a-e327-4c49-ab23-5f606e636928]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmsiivj24/f36e999e611643c49cb9d8441e71e2cf.delta /opt/stack/data/nova/instances/snapshots/tmpmsiivj24/f36e999e611643c49cb9d8441e71e2cf {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c9a22-3c76-40ae-8e48-12f290c90cf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7db6e-0a27-4baf-9d2a-788c0c9f8bee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc90aab3-4492-4a9f-9f2d-27081db192bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:28:46 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aeb03e-b2f2-41a4-abfb-a3611774677d]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG os_brick.utils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Updating existing volume attachment record: fee29078-2148-44ae-b607-daa1e4a9ea8c {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:28:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmsiivj24/f36e999e611643c49cb9d8441e71e2cf.delta /opt/stack/data/nova/instances/snapshots/tmpmsiivj24/f36e999e611643c49cb9d8441e71e2cf" returned: 0 in 0.594s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:28:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Snapshot extracted, beginning image upload
Oct 20 16:28:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:49 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Snapshot image upload complete
Oct 20 16:28:49 user nova-compute[74131]: INFO nova.compute.manager [None req-14b4d1ec-d61a-4052-937b-49b2c874394d tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Took 5.89 seconds to snapshot the instance on the hypervisor.
Oct 20 16:28:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-changed-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Refreshing instance network info cache due to event network-changed-7a8f5260-8511-466c-b422-3e6156d8b3cc. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] Acquiring lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] Acquired lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG nova.network.neutron [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Refreshing network info cache for port 7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG nova.network.neutron [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updated VIF entry in instance network info cache for port 7a8f5260-8511-466c-b422-3e6156d8b3cc. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG nova.network.neutron [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updating instance_info_cache with network_info: [{"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:28:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-52aabe55-b5ac-4a73-96b8-2f1fba7b11cc req-ebb7aa4d-dccf-4c4b-aa29-ca567d4ae1d6 service nova] Releasing lock "refresh_cache-4b745a18-2505-4af6-874f-c09de7cdad2c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:28:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:28:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG nova.compute.manager [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-changed-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG nova.compute.manager [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Refreshing instance network info cache due to event network-changed-63aa31e1-90f1-4666-8afa-aa2333595208. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] Acquiring lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] Acquired lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG nova.network.neutron [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Refreshing network info cache for port 63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG nova.network.neutron [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updated VIF entry in instance network info cache for port 63aa31e1-90f1-4666-8afa-aa2333595208. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG nova.network.neutron [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updating instance_info_cache with network_info: [{"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a23910d0-c08b-490f-91cc-4a34130372b3 req-b290a5c8-2b84-42d4-9061-a207abd09f82 service nova] Releasing lock "refresh_cache-5e111d85-bd8d-40b4-b664-8ab924063cb6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeAxjsiE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:03 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:03 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:03 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:29:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[813f3be9-fff0-4cd2-83db-fb8cdefdab10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:29:03 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a043cf65-fc0b-4af3-9c7d-c2cdde117658]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed] added
Oct 20 16:29:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ef9d3-b43c-4583-931b-d5d5a3f47358]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a66495-4a55-4b59-8eb3-02d0f2b92a68]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aeAxjsiE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aeAxjsiE" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[747980a9-872b-41b9-9e99-9c310bcc0ff2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aeAxjsiE'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e22c206-5ecd-49d6-b7bd-0cebf60086bc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a9de7-4308-4354-b293-10f4dd73387a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:29:04 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:29:04 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:04 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 16:29:04 user nova-compute[74131]: 
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 4b745a18-2505-4af6-874f-c09de7cdad2c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab9a47-b94b-4cfd-b8fe-931a53c11044]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260]
Oct 20 16:29:04 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260] successful.
Oct 20 16:29:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[face78f5-f380-4a70-a7cb-7a1316443805]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54776ea-a88c-4d6b-8c7c-ad92e77f5fe6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed (non-flash)
Oct 20 16:29:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed (non-flash)
Oct 20 16:29:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94805fe-68d2-4fee-8057-133bf59aed5c]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeAxjsiE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:04 user nova-compute[74131]: INFO nova.compute.manager [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Attaching volume ba10e328-4236-4c6b-8681-5f77e94bb3d2 to /dev/vdb
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.utils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec6a421-9ce7-40ac-8cbb-986f039443d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af2a27-b5df-434d-9acb-20c530aacbca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c256d8-a71b-44c6-9c7c-8725229f0b29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3bffa8-17da-447d-9640-fc04008b0d86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:04 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:29:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8c02b4-dd79-4efd-a31b-9aa3f82a154a]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG os_brick.utils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updating existing volume attachment record: 038b1bb3-290c-4972-b634-5ed95d60d8e0 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:29:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23664663536313631', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664663536313631', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lazy-loading 'flavor' on Instance uuid 9aee3d08-7204-4215-9e6a-0d52766749f5 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:29:05 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:05 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:29:05 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:05 user nova-compute[74131]:   <serial>0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed</serial>
Oct 20 16:29:05 user nova-compute[74131]: </disk>
Oct 20 16:29:05 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] No VIF found with MAC fa:16:3e:86:7e:b3, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:29:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e88855f6-c7f7-4cbf-bac1-8295b2b700a7 tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.937s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:07 user nova-compute[74131]: INFO nova.compute.manager [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Detaching volume 0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed
Oct 20 16:29:07 user nova-compute[74131]: INFO nova.virt.block_device [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Attempting to driver detach volume 0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed from mountpoint /dev/vdb
Oct 20 16:29:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Attempting to detach device vdb from instance 9aee3d08-7204-4215-9e6a-0d52766749f5 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:29:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:29:07 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:07 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:29:07 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:07 user nova-compute[74131]:   <serial>0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed</serial>
Oct 20 16:29:07 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:29:07 user nova-compute[74131]: </disk>
Oct 20 16:29:07 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:29:07 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Successfully detached device vdb from instance 9aee3d08-7204-4215-9e6a-0d52766749f5 from the persistent domain config.
Oct 20 16:29:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9aee3d08-7204-4215-9e6a-0d52766749f5 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:29:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:29:07 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:07 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:29:07 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:07 user nova-compute[74131]:   <serial>0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed</serial>
Oct 20 16:29:07 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:29:07 user nova-compute[74131]: </disk>
Oct 20 16:29:07 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9aee3d08-7204-4215-9e6a-0d52766749f5 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lazy-loading 'flavor' on Instance uuid 5e111d85-bd8d-40b4-b664-8ab924063cb6 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:08 user nova-compute[74131]: INFO nova.compute.manager [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Attaching volume d43af997-862f-418f-a9b2-97a2351260e0 to /dev/vdb
Oct 20 16:29:08 user nova-compute[74131]: DEBUG os_brick.utils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dfbc65-7ce6-4658-9d41-5a69836687ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c947ee-099d-4b7c-b296-d1ec33195bfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[060f1033-8bf9-4a8e-a7a6-a6abc7595489]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[990df8be-f905-4a79-94fa-b95c5f7db4e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:08 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:29:08 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee27794-412e-49fa-86e5-5744d398459b]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG os_brick.utils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:08 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updating existing volume attachment record: 1b8ac8ad-dc92-4d95-8d42-e0642da4688a {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:29:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:15 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:29:16 user nova-compute[74131]: INFO nova.compute.claims [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Claim successful on node user
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:29:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.policy [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f6bff83a2e24a289333823acf911ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db8a4e064f445abd0a8555aaa18b88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:29:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Creating image(s)
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk 1073741824" returned: 0 in 0.052s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Successfully created port: 9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.215s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Cannot resize image /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Ensure instance console log exists: /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "810cb8ab-756c-46df-a052-839812e83ec2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "810cb8ab-756c-46df-a052-839812e83ec2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:29:17 user nova-compute[74131]: INFO nova.compute.claims [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Claim successful on node user
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Successfully updated port: 9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquired lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-changed-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Refreshing instance network info cache due to event network-changed-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] Acquiring lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating instance_info_cache with network_info: [{"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Releasing lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance network_info: |[{"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] Acquired lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.neutron [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Refreshing network info cache for port 9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Start _get_guest_xml network_info=[{"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.neutron [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:29:18 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:29:18 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:29:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-922119915',display_name='tempest-tempest.common.compute-instance-922119915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-922119915',id=22,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClsw25KmejLndYBIRuFDpZeoBzz0XFoBnGaNFpUkFZ2ueCXES09aknXNcKDwgLJ0hSqiuxQFmvUMbjJI9W+CvysCsH9vDWL9/yf5HU69VDrewq3TaRiKAWilU8ELN8rSg==',key_name='tempest-keypair-41371766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-p30mggky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=4fdc0030-fba0-4beb-bfd5-b1179c1868a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:29:18 user nova-compute[74131]:   <uuid>4fdc0030-fba0-4beb-bfd5-b1179c1868a1</uuid>
Oct 20 16:29:18 user nova-compute[74131]:   <name>instance-00000016</name>
Oct 20 16:29:18 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:29:18 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:29:18 user nova-compute[74131]:   <metadata>
Oct 20 16:29:18 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:29:18 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:29:18 user nova-compute[74131]:       <nova:name>tempest-tempest.common.compute-instance-922119915</nova:name>
Oct 20 16:29:18 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:29:18</nova:creationTime>
Oct 20 16:29:18 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:29:18 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:29:18 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:29:18 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:29:18 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:29:18 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:29:18 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:29:18 user nova-compute[74131]:       <nova:owner>
Oct 20 16:29:18 user nova-compute[74131]:         <nova:user uuid="2f6bff83a2e24a289333823acf911ccd">tempest-ServerActionsTestOtherA-844175334-project-member</nova:user>
Oct 20 16:29:18 user nova-compute[74131]:         <nova:project uuid="69db8a4e064f445abd0a8555aaa18b88">tempest-ServerActionsTestOtherA-844175334</nova:project>
Oct 20 16:29:18 user nova-compute[74131]:       </nova:owner>
Oct 20 16:29:18 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:29:18 user nova-compute[74131]:       <nova:ports>
Oct 20 16:29:18 user nova-compute[74131]:         <nova:port uuid="9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e">
Oct 20 16:29:18 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 16:29:18 user nova-compute[74131]:         </nova:port>
Oct 20 16:29:18 user nova-compute[74131]:       </nova:ports>
Oct 20 16:29:18 user nova-compute[74131]:     </nova:instance>
Oct 20 16:29:18 user nova-compute[74131]:   </metadata>
Oct 20 16:29:18 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:29:18 user nova-compute[74131]:     <system>
Oct 20 16:29:18 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:29:18 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:29:18 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:29:18 user nova-compute[74131]:       <entry name="serial">4fdc0030-fba0-4beb-bfd5-b1179c1868a1</entry>
Oct 20 16:29:18 user nova-compute[74131]:       <entry name="uuid">4fdc0030-fba0-4beb-bfd5-b1179c1868a1</entry>
Oct 20 16:29:18 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:29:18 user nova-compute[74131]:     </system>
Oct 20 16:29:18 user nova-compute[74131]:   </sysinfo>
Oct 20 16:29:18 user nova-compute[74131]:   <os>
Oct 20 16:29:18 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:29:18 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:29:18 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:29:18 user nova-compute[74131]:   </os>
Oct 20 16:29:18 user nova-compute[74131]:   <features>
Oct 20 16:29:18 user nova-compute[74131]:     <acpi/>
Oct 20 16:29:18 user nova-compute[74131]:     <apic/>
Oct 20 16:29:18 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:29:18 user nova-compute[74131]:   </features>
Oct 20 16:29:18 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:29:18 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:29:18 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:29:18 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:29:18 user nova-compute[74131]:   </clock>
Oct 20 16:29:18 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:29:18 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:29:18 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:29:18 user nova-compute[74131]:   </cpu>
Oct 20 16:29:18 user nova-compute[74131]:   <devices>
Oct 20 16:29:18 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:29:18 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:29:18 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk"/>
Oct 20 16:29:18 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:29:18 user nova-compute[74131]:     </disk>
Oct 20 16:29:18 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:29:18 user nova-compute[74131]:       <mac address="fa:16:3e:78:ef:ca"/>
Oct 20 16:29:18 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:29:18 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:29:18 user nova-compute[74131]:       <target dev="tap9e77cb4a-26"/>
Oct 20 16:29:18 user nova-compute[74131]:     </interface>
Oct 20 16:29:18 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:29:18 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/console.log" append="off"/>
Oct 20 16:29:18 user nova-compute[74131]:     </serial>
Oct 20 16:29:18 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:29:18 user nova-compute[74131]:     <video>
Oct 20 16:29:18 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:29:18 user nova-compute[74131]:     </video>
Oct 20 16:29:18 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:29:18 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:29:18 user nova-compute[74131]:     </rng>
Oct 20 16:29:18 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:29:18 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:29:18 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:29:18 user nova-compute[74131]:     </memballoon>
Oct 20 16:29:18 user nova-compute[74131]:   </devices>
Oct 20 16:29:18 user nova-compute[74131]: </domain>
Oct 20 16:29:18 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-922119915',display_name='tempest-tempest.common.compute-instance-922119915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-922119915',id=22,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClsw25KmejLndYBIRuFDpZeoBzz0XFoBnGaNFpUkFZ2ueCXES09aknXNcKDwgLJ0hSqiuxQFmvUMbjJI9W+CvysCsH9vDWL9/yf5HU69VDrewq3TaRiKAWilU8ELN8rSg==',key_name='tempest-keypair-41371766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-p30mggky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=4fdc0030-fba0-4beb-bfd5-b1179c1868a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG os_vif [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93a13243-93b7-59c3-b2cc-827860032715', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.policy [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c0f3a5e9862491897ec87644c577ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08267e8d79941d3a555dc3a51c58985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e77cb4a-26, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e77cb4a-26, col_values=(('qos', UUID('e2a3acae-e15e-4341-b3e0-b9d26281e62e')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e77cb4a-26, col_values=(('external_ids', {'iface-id': '9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:ef:ca', 'vm-uuid': '4fdc0030-fba0-4beb-bfd5-b1179c1868a1'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:29:18 user nova-compute[74131]: INFO nova.virt.block_device [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Booting with volume snapshot 0fe093a1-8b17-462c-9b13-bab98216b200 at /dev/vda
Oct 20 16:29:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:18 user nova-compute[74131]: INFO os_vif [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26')
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No VIF found with MAC fa:16:3e:78:ef:ca, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.neutron [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updated VIF entry in instance network info cache for port 9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG nova.network.neutron [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating instance_info_cache with network_info: [{"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-66321b16-5d42-4993-9c9c-8e15044059a9 req-5abfb944-76de-46c4-a670-ae7fae73427f service nova] Releasing lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Successfully created port: 202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:29:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Successfully updated port: 202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "refresh_cache-810cb8ab-756c-46df-a052-839812e83ec2" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquired lock "refresh_cache-810cb8ab-756c-46df-a052-839812e83ec2" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received event network-changed-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Refreshing instance network info cache due to event network-changed-202e4ef3-d665-4e02-8c18-6c45c0fb21d9. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] Acquiring lock "refresh_cache-810cb8ab-756c-46df-a052-839812e83ec2" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Updating instance_info_cache with network_info: [{"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Releasing lock "refresh_cache-810cb8ab-756c-46df-a052-839812e83ec2" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Instance network_info: |[{"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] Acquired lock "refresh_cache-810cb8ab-756c-46df-a052-839812e83ec2" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG nova.network.neutron [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Refreshing network info cache for port 202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:29:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Updated VIF entry in instance network info cache for port 202e4ef3-d665-4e02-8c18-6c45c0fb21d9. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Updating instance_info_cache with network_info: [{"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aee3f620-3500-4e95-971a-e8f379bce6d3 req-947f83dc-521f-46d9-a49e-bbadf283be5d service nova] Releasing lock "refresh_cache-810cb8ab-756c-46df-a052-839812e83ec2" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:29:22 user nova-compute[74131]: WARNING nova.compute.manager [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state building and task_state spawning.
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:29:22 user nova-compute[74131]: WARNING nova.compute.manager [req-f4668801-838f-46c7-a91e-433abd959d7e req-c108e7d5-0649-40db-a739-4da22431b38b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state building and task_state spawning.
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:29:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance spawned successfully.
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:29:22 user nova-compute[74131]: INFO nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:29:22 user nova-compute[74131]: INFO nova.compute.manager [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Took 6.60 seconds to build instance.
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b76d61a4-96e2-4243-b7c4-de1ab061eee0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.738s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG os_brick.utils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43b5b91-5931-47ae-8a2f-b9cf10ae3945]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7914a1-d404-4534-bf85-8839d8acce2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[30669da4-124f-4a23-bf54-abfa16ec4b1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da9332-60fe-4246-b365-cf73ffa805f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:25 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e0ad40-c35d-4cc5-bc61-fde5447ac484]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG os_brick.utils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Updating existing volume attachment record: 3f626691-bca3-4b9a-a04d-db04e7bdd3e0 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:26 user nova-compute[74131]: INFO nova.compute.manager [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Unshelving
Oct 20 16:29:26 user nova-compute[74131]: INFO nova.virt.block_device [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Booting with volume 7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 at /dev/vdc
Oct 20 16:29:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:29:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7926MB free_disk=25.311962127685547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9aee3d08-7204-4215-9e6a-0d52766749f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4b745a18-2505-4af6-874f-c09de7cdad2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 810cb8ab-756c-46df-a052-839812e83ec2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 52b4f002-76fb-45c7-8b60-25c56d40740c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:29:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9aee3d08-7204-4215-9e6a-0d52766749f5 is timed out.
Oct 20 16:29:28 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Successfully detached device vdb from instance 9aee3d08-7204-4215-9e6a-0d52766749f5 from the live domain config.
Oct 20 16:29:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeAxjsiE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:28 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a69f0e4-9aa6-4f44-b7be-f34816dacd92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:29:28 user nova-compute[74131]: No targets found.
Oct 20 16:29:28 user nova-compute[74131]: iSNS:
Oct 20 16:29:28 user nova-compute[74131]: No targets found.
Oct 20 16:29:28 user nova-compute[74131]: STATIC:
Oct 20 16:29:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed
Oct 20 16:29:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:29:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:29:28 user nova-compute[74131]: FIRMWARE:
Oct 20 16:29:28 user nova-compute[74131]: No targets found.
Oct 20 16:29:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:29:28 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:29:28 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0285665-f41b-4f06-b1bc-ae76be823354]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[55995d45-079d-4775-85b6-c75ffb0dff4e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed (non-flash)
Oct 20 16:29:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed (non-flash)
Oct 20 16:29:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c82e1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c43d8f-5977-4a44-99ce-0f472a20b90c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47caa85-71aa-4d1c-9028-5aedc87f75e4]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1763d859-5efb-4c9b-b32c-dd825be6ec87]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f39b85-eb86-417b-a7b2-b4d60f22cbba]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7d1a99-223f-41c9-a1f5-71cb9d3f50bc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80eaae-1981-4fe4-bdb0-371dbe729e52]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260]
Oct 20 16:29:28 user nova-compute[74131]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed, portal: 172.16.0.220,3260] successful.
Oct 20 16:29:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0977cdbc-421b-40b8-8ae6-5b39f1d4f4ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfe5862-02c4-44ef-b3ea-af2f94fd0270]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] <== disconnect_volume: return (326ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:29:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lazy-loading 'flavor' on Instance uuid 9aee3d08-7204-4215-9e6a-0d52766749f5 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fec3c817-4e08-4a92-805a-d00b58adbf1d tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.862s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.utils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:29:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Creating image(s)
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Ensure instance console log exists: /opt/stack/data/nova/instances/810cb8ab-756c-46df-a052-839812e83ec2/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Start _get_guest_xml network_info=[{"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3f626691-bca3-4b9a-a04d-db04e7bdd3e0', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UckFqiOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '810cb8ab-756c-46df-a052-839812e83ec2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a11e6757-59c2-413f-a345-d5db64cc3608', 'serial': 'a11e6757-59c2-413f-a345-d5db64cc3608'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ccb4d3-8ca9-4bbb-9d9c-090b1d194107]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:29:43 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UckFqiOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:43 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:43 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:43 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1773dab6-4897-4ec0-a9dc-7e849f5608a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba2e917-b8e8-426a-8ec5-7550fb687cc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:29:43 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c07fa1-f40c-4d82-bf26-eef2902b8ad8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c5ffb5-9822-4547-b286-803ca0e23df9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3e369d-ae94-43b9-9d72-dadf94cd933c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608] added
Oct 20 16:29:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:43 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f0276-7b9d-4a82-b202-75ac84860c81]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.utils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating existing volume attachment record: 54541ef5-792e-4050-8e19-e6cb2827c4fd {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[009fc62f-119e-44e6-8a6d-4d426a953e19]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0453f7b1-9010-45cc-b4e3-8b406961b494]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UckFqiOu {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UckFqiOu" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f6fbd1-c3ba-495d-8828-2b0baddbb0ef]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UckFqiOu'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713aaee-485e-4ed0-915c-5245aafa22de]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[788fdcbb-72a2-4d82-81f8-3cbacc10e01d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:29:44 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:29:44 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:44 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 16:29:44 user nova-compute[74131]: 
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ffa60c-9d2a-4f23-aaa8-ee85bd2cc3e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260]
Oct 20 16:29:44 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260] successful.
Oct 20 16:29:44 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c3d20-670e-4c33-a99e-7b59d75458a8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c6418-6c3c-4ad9-b02f-2ba5c840e8af]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:44 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:44 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b4e04-39b8-4e9f-87aa-0900cc4d1ae4]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiWjVbhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:44 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMUfgiEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:44 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UckFqiOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23630333061363032', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630333061363032', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.743s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:45 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[675a0bfb-0052-47fa-868a-0b0dd37f2baa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:29:45 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-699937794',display_name='tempest-TestVolumeBootPattern-server-699937794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-699937794',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-cdtz03c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:18Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=810cb8ab-756c-46df-a052-839812e83ec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:71:39,bridge_name='br-int',has_traffic_filtering=True,id=202e4ef3-d665-4e02-8c18-6c45c0fb21d9,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap202e4ef3-d6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'pci_devices' on Instance uuid 810cb8ab-756c-46df-a052-839812e83ec2 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2dd056-e2c3-4239-b8ea-3baea71bf83f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2] added
Oct 20 16:29:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:29:45 user nova-compute[74131]:   <uuid>810cb8ab-756c-46df-a052-839812e83ec2</uuid>
Oct 20 16:29:45 user nova-compute[74131]:   <name>instance-00000017</name>
Oct 20 16:29:45 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:29:45 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:29:45 user nova-compute[74131]:   <metadata>
Oct 20 16:29:45 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:29:45 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:29:45 user nova-compute[74131]:       <nova:name>tempest-TestVolumeBootPattern-server-699937794</nova:name>
Oct 20 16:29:45 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:29:43</nova:creationTime>
Oct 20 16:29:45 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:29:45 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:29:45 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:29:45 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:29:45 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:29:45 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:29:45 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:29:45 user nova-compute[74131]:       <nova:owner>
Oct 20 16:29:45 user nova-compute[74131]:         <nova:user uuid="6c0f3a5e9862491897ec87644c577ebf">tempest-TestVolumeBootPattern-978997028-project-member</nova:user>
Oct 20 16:29:45 user nova-compute[74131]:         <nova:project uuid="a08267e8d79941d3a555dc3a51c58985">tempest-TestVolumeBootPattern-978997028</nova:project>
Oct 20 16:29:45 user nova-compute[74131]:       </nova:owner>
Oct 20 16:29:45 user nova-compute[74131]:       <nova:ports>
Oct 20 16:29:45 user nova-compute[74131]:         <nova:port uuid="202e4ef3-d665-4e02-8c18-6c45c0fb21d9">
Oct 20 16:29:45 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:29:45 user nova-compute[74131]:         </nova:port>
Oct 20 16:29:45 user nova-compute[74131]:       </nova:ports>
Oct 20 16:29:45 user nova-compute[74131]:     </nova:instance>
Oct 20 16:29:45 user nova-compute[74131]:   </metadata>
Oct 20 16:29:45 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:29:45 user nova-compute[74131]:     <system>
Oct 20 16:29:45 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:29:45 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:29:45 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:29:45 user nova-compute[74131]:       <entry name="serial">810cb8ab-756c-46df-a052-839812e83ec2</entry>
Oct 20 16:29:45 user nova-compute[74131]:       <entry name="uuid">810cb8ab-756c-46df-a052-839812e83ec2</entry>
Oct 20 16:29:45 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:29:45 user nova-compute[74131]:     </system>
Oct 20 16:29:45 user nova-compute[74131]:   </sysinfo>
Oct 20 16:29:45 user nova-compute[74131]:   <os>
Oct 20 16:29:45 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:29:45 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:29:45 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:29:45 user nova-compute[74131]:   </os>
Oct 20 16:29:45 user nova-compute[74131]:   <features>
Oct 20 16:29:45 user nova-compute[74131]:     <acpi/>
Oct 20 16:29:45 user nova-compute[74131]:     <apic/>
Oct 20 16:29:45 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:29:45 user nova-compute[74131]:   </features>
Oct 20 16:29:45 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:29:45 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:29:45 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:29:45 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:29:45 user nova-compute[74131]:   </clock>
Oct 20 16:29:45 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:29:45 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:29:45 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:29:45 user nova-compute[74131]:   </cpu>
Oct 20 16:29:45 user nova-compute[74131]:   <devices>
Oct 20 16:29:45 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:29:45 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:45 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 16:29:45 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:29:45 user nova-compute[74131]:       <serial>a11e6757-59c2-413f-a345-d5db64cc3608</serial>
Oct 20 16:29:45 user nova-compute[74131]:     </disk>
Oct 20 16:29:45 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:29:45 user nova-compute[74131]:       <mac address="fa:16:3e:95:71:39"/>
Oct 20 16:29:45 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:29:45 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:29:45 user nova-compute[74131]:       <target dev="tap202e4ef3-d6"/>
Oct 20 16:29:45 user nova-compute[74131]:     </interface>
Oct 20 16:29:45 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:29:45 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/810cb8ab-756c-46df-a052-839812e83ec2/console.log" append="off"/>
Oct 20 16:29:45 user nova-compute[74131]:     </serial>
Oct 20 16:29:45 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:29:45 user nova-compute[74131]:     <video>
Oct 20 16:29:45 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:29:45 user nova-compute[74131]:     </video>
Oct 20 16:29:45 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:29:45 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:29:45 user nova-compute[74131]:     </rng>
Oct 20 16:29:45 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:29:45 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:29:45 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:29:45 user nova-compute[74131]:     </memballoon>
Oct 20 16:29:45 user nova-compute[74131]:   </devices>
Oct 20 16:29:45 user nova-compute[74131]: </domain>
Oct 20 16:29:45 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-699937794',display_name='tempest-TestVolumeBootPattern-server-699937794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-699937794',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-cdtz03c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:18Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=810cb8ab-756c-46df-a052-839812e83ec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:71:39,bridge_name='br-int',has_traffic_filtering=True,id=202e4ef3-d665-4e02-8c18-6c45c0fb21d9,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap202e4ef3-d6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_vif [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:71:39,bridge_name='br-int',has_traffic_filtering=True,id=202e4ef3-d665-4e02-8c18-6c45c0fb21d9,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap202e4ef3-d6') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81752354-ea29-5529-a054-81cd85dc5625', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249525a-0fe5-4619-a5b2-da5aa3ffb7a9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap202e4ef3-d6, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap202e4ef3-d6, col_values=(('qos', UUID('633b722e-3db6-45a1-99bf-b20b769da123')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap202e4ef3-d6, col_values=(('external_ids', {'iface-id': '202e4ef3-d665-4e02-8c18-6c45c0fb21d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:71:39', 'vm-uuid': '810cb8ab-756c-46df-a052-839812e83ec2'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[914f47de-8308-4896-9e4d-0cf752abbe84]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiWjVbhg {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:45 user nova-compute[74131]: INFO os_vif [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:71:39,bridge_name='br-int',has_traffic_filtering=True,id=202e4ef3-d665-4e02-8c18-6c45c0fb21d9,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap202e4ef3-d6')
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiWjVbhg" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e675ef-48e0-4584-81a9-383722d9a35c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YiWjVbhg'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea76456a-ec3c-4728-b132-68fb8b539bfd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No VIF found with MAC fa:16:3e:95:71:39, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae63645-e319-467c-b4f2-c458c85a8240]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e8c014-eac3-4486-8c58-adb546186a03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260]
Oct 20 16:29:45 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260] successful.
Oct 20 16:29:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc28e7-3987-4cf1-b36c-56649baec323]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfb3890-f70e-4db9-a349-9befde1b3690]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:45 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:29:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:45 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:29:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078e77f-2402-493e-8007-64528f7e39ba]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiWjVbhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== connect_volume: return (2100ms) {'type': 'block', 'scsi_wwn': '23536303366386137', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536303366386137', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.048s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:46 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:29:46 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 4b745a18-2505-4af6-874f-c09de7cdad2c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a5d1c7-4ee1-4b69-a440-2c81120d9bd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:29:46 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:29:46 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:46 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:29:46 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:46 user nova-compute[74131]:   <serial>ba10e328-4236-4c6b-8681-5f77e94bb3d2</serial>
Oct 20 16:29:46 user nova-compute[74131]: </disk>
Oct 20 16:29:46 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1edc96-6333-4f61-bfe5-1e35ee4174f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0] added
Oct 20 16:29:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a237f3-7d22-451e-8891-d49101da608f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4216d3c3-6162-4815-949c-588547959232]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMUfgiEv {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMUfgiEv" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d352e-e050-4ade-b99d-07a6b730b620]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMUfgiEv'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d69d1a6-e4a1-487e-bc7b-74d377e3e1c9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[17463baf-3af7-48c7-9ab5-3a467eb05a0c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44630b5-ad24-43e8-86a3-ab3b0d370e1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260]
Oct 20 16:29:46 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260] successful.
Oct 20 16:29:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce52079-aae0-4eab-bcdf-cc247653ebfc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51dc08c-a36a-4ee1-99fa-403e4cda84d5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)
Oct 20 16:29:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8840e09-54da-4441-83fb-3430694a72bd]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:29:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMUfgiEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-b4ace905-bf97-4212-abb8-14968a197cc0 req-c0ca3532-29c0-45f8-8f68-0e3e8483e5f1 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received event network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b4ace905-bf97-4212-abb8-14968a197cc0 req-c0ca3532-29c0-45f8-8f68-0e3e8483e5f1 service nova] Acquiring lock "810cb8ab-756c-46df-a052-839812e83ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b4ace905-bf97-4212-abb8-14968a197cc0 req-c0ca3532-29c0-45f8-8f68-0e3e8483e5f1 service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b4ace905-bf97-4212-abb8-14968a197cc0 req-c0ca3532-29c0-45f8-8f68-0e3e8483e5f1 service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-b4ace905-bf97-4212-abb8-14968a197cc0 req-c0ca3532-29c0-45f8-8f68-0e3e8483e5f1 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] No waiting events found dispatching network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:29:47 user nova-compute[74131]: WARNING nova.compute.manager [req-b4ace905-bf97-4212-abb8-14968a197cc0 req-c0ca3532-29c0-45f8-8f68-0e3e8483e5f1 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received unexpected event network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 for instance with vm_state building and task_state spawning.
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No VIF found with MAC fa:16:3e:42:82:34, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-560d3576-cc83-4de1-9fff-5a23d659f519 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.983s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] <== connect_volume: return (3420ms) {'type': 'block', 'scsi_wwn': '23035343037323266', 'path': '/dev/sdd'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035343037323266', 'path': '/dev/sdd'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lazy-loading 'flavor' on Instance uuid 5e111d85-bd8d-40b4-b664-8ab924063cb6 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:29:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:29:47 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:47 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:29:47 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:47 user nova-compute[74131]:   <serial>d43af997-862f-418f-a9b2-97a2351260e0</serial>
Oct 20 16:29:47 user nova-compute[74131]: </disk>
Oct 20 16:29:47 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:29:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:29:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] No VIF found with MAC fa:16:3e:5f:ff:b0, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:29:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8e35dfb1-92dc-4c36-a723-bffcc68bd611 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.885s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:48 user nova-compute[74131]: INFO nova.compute.manager [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Detaching volume ba10e328-4236-4c6b-8681-5f77e94bb3d2
Oct 20 16:29:48 user nova-compute[74131]: INFO nova.virt.block_device [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Attempting to driver detach volume ba10e328-4236-4c6b-8681-5f77e94bb3d2 from mountpoint /dev/vdb
Oct 20 16:29:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Attempting to detach device vdb from instance 4b745a18-2505-4af6-874f-c09de7cdad2c from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:29:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:29:48 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:48 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:29:48 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:48 user nova-compute[74131]:   <serial>ba10e328-4236-4c6b-8681-5f77e94bb3d2</serial>
Oct 20 16:29:48 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:29:48 user nova-compute[74131]: </disk>
Oct 20 16:29:48 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:29:49 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully detached device vdb from instance 4b745a18-2505-4af6-874f-c09de7cdad2c from the persistent domain config.
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b745a18-2505-4af6-874f-c09de7cdad2c from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:29:49 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:49 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:29:49 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:49 user nova-compute[74131]:   <serial>ba10e328-4236-4c6b-8681-5f77e94bb3d2</serial>
Oct 20 16:29:49 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:29:49 user nova-compute[74131]: </disk>
Oct 20 16:29:49 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-2fff2670-18d1-43b6-90dd-69c481280d2a req-b853d165-cea4-4acd-89c8-0a38127ca854 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received event network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2fff2670-18d1-43b6-90dd-69c481280d2a req-b853d165-cea4-4acd-89c8-0a38127ca854 service nova] Acquiring lock "810cb8ab-756c-46df-a052-839812e83ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2fff2670-18d1-43b6-90dd-69c481280d2a req-b853d165-cea4-4acd-89c8-0a38127ca854 service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2fff2670-18d1-43b6-90dd-69c481280d2a req-b853d165-cea4-4acd-89c8-0a38127ca854 service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-2fff2670-18d1-43b6-90dd-69c481280d2a req-b853d165-cea4-4acd-89c8-0a38127ca854 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] No waiting events found dispatching network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:29:49 user nova-compute[74131]: WARNING nova.compute.manager [req-2fff2670-18d1-43b6-90dd-69c481280d2a req-b853d165-cea4-4acd-89c8-0a38127ca854 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received unexpected event network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 for instance with vm_state building and task_state spawning.
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:29:49 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Instance spawned successfully.
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:29:49 user nova-compute[74131]: INFO nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b745a18-2505-4af6-874f-c09de7cdad2c {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:29:49 user nova-compute[74131]: INFO nova.compute.manager [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Took 31.72 seconds to build instance.
Oct 20 16:29:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7b9ea17f-dc2f-4b50-b196-c7132f1db06f tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "810cb8ab-756c-46df-a052-839812e83ec2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.827s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:50 user nova-compute[74131]: INFO nova.compute.manager [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Detaching volume d43af997-862f-418f-a9b2-97a2351260e0
Oct 20 16:29:50 user nova-compute[74131]: INFO nova.virt.block_device [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Attempting to driver detach volume d43af997-862f-418f-a9b2-97a2351260e0 from mountpoint /dev/vdb
Oct 20 16:29:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Attempting to detach device vdb from instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:29:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:29:50 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:50 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:29:50 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:50 user nova-compute[74131]:   <serial>d43af997-862f-418f-a9b2-97a2351260e0</serial>
Oct 20 16:29:50 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:29:50 user nova-compute[74131]: </disk>
Oct 20 16:29:50 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:29:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Successfully detached device vdb from instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 from the persistent domain config.
Oct 20 16:29:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:29:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:29:50 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:29:50 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:29:50 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:29:50 user nova-compute[74131]:   <serial>d43af997-862f-418f-a9b2-97a2351260e0</serial>
Oct 20 16:29:50 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:29:50 user nova-compute[74131]: </disk>
Oct 20 16:29:50 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:29:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:29:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:29:52 user nova-compute[74131]: INFO nova.compute.claims [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Claim successful on node user
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:29:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:29:52 user nova-compute[74131]: INFO nova.virt.block_device [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Booting with blank volume at /dev/vda
Oct 20 16:29:52 user nova-compute[74131]: DEBUG nova.policy [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82534b86e314f00896042e2e684a623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097a2eccca244cbfa897e6a573a3113d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:29:53 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Successfully created port: 464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Successfully updated port: 464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-changed-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Refreshing instance network info cache due to event network-changed-464ba822-ba37-482b-9a97-7bea0352d5d3. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] Acquiring lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating instance_info_cache with network_info: [{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance network_info: |[{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] Acquired lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Refreshing network info cache for port 464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:29:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updated VIF entry in instance network info cache for port 464ba822-ba37-482b-9a97-7bea0352d5d3. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:29:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating instance_info_cache with network_info: [{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:29:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a6d7a000-0c22-481e-a592-aefc77e32f75 req-76928c9a-0231-4874-9072-41c0bf2c7a0d service nova] Releasing lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:29:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG os_brick.utils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ad1477-dcc0-45a6-b761-3cf34b2d5907]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[29668c09-d7e6-4b51-83bc-d4d07c8d9165]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1e5fba-77f0-47c1-b32e-290aa81ab32c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416123b-e0a8-4cd5-8fae-25c6897cf7e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:29:58 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:29:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dcd75e-79cb-4e92-94c0-0be8950fa7b2]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG os_brick.utils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:29:58 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating existing volume attachment record: 858ede3d-f535-483a-8467-9cd0fc71f178 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:30:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:07 user nova-compute[74131]: INFO nova.compute.manager [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Terminating instance
Oct 20 16:30:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-37cef0ea-afe5-439c-981f-5901686df435 req-c5ecb736-b3fd-4d2c-9076-5c173ce56ed1 service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-vif-unplugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37cef0ea-afe5-439c-981f-5901686df435 req-c5ecb736-b3fd-4d2c-9076-5c173ce56ed1 service nova] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37cef0ea-afe5-439c-981f-5901686df435 req-c5ecb736-b3fd-4d2c-9076-5c173ce56ed1 service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37cef0ea-afe5-439c-981f-5901686df435 req-c5ecb736-b3fd-4d2c-9076-5c173ce56ed1 service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-37cef0ea-afe5-439c-981f-5901686df435 req-c5ecb736-b3fd-4d2c-9076-5c173ce56ed1 service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] No waiting events found dispatching network-vif-unplugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-37cef0ea-afe5-439c-981f-5901686df435 req-c5ecb736-b3fd-4d2c-9076-5c173ce56ed1 service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-vif-unplugged-b01038b9-456e-4165-9139-f89acc4aecd1 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:30:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Instance destroyed successfully.
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lazy-loading 'resources' on Instance uuid 9aee3d08-7204-4215-9e6a-0d52766749f5 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1373150389',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1373150389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1373150',id=18,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yWLjnpvytj2M3A4O/8LgJawtqQ0WxzWmKKjJbaCrknzajtF8VkO1iufxYogzHbKeFIuHGtQnUsYo7fxGjeT4eDruWmYdQq0on1O8OpBwVZ10BLnUSmArM0ppLawhftg==',key_name='tempest-keypair-1060974344',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='009462210022422a989156ddb05b7dac',ramdisk_id='',reservation_id='r-074mrtpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-390058125',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb36fa11f0e046f3b76fe0854b333289',uuid=9aee3d08-7204-4215-9e6a-0d52766749f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Converting VIF {"id": "b01038b9-456e-4165-9139-f89acc4aecd1", "address": "fa:16:3e:86:7e:b3", "network": {"id": "7e118b93-7b35-4ef7-b555-300fa3f353cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1878211037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009462210022422a989156ddb05b7dac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01038b9-45", "ovs_interfaceid": "b01038b9-456e-4165-9139-f89acc4aecd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:7e:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01038b9-456e-4165-9139-f89acc4aecd1,network=Network(7e118b93-7b35-4ef7-b555-300fa3f353cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01038b9-45') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG os_vif [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:7e:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01038b9-456e-4165-9139-f89acc4aecd1,network=Network(7e118b93-7b35-4ef7-b555-300fa3f353cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01038b9-45') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb01038b9-45, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=127d55df-9ac8-419a-a700-ceff8f25612a) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:08 user nova-compute[74131]: INFO os_vif [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:7e:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01038b9-456e-4165-9139-f89acc4aecd1,network=Network(7e118b93-7b35-4ef7-b555-300fa3f353cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01038b9-45')
Oct 20 16:30:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Deleting instance files /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5_del
Oct 20 16:30:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Deletion of /opt/stack/data/nova/instances/9aee3d08-7204-4215-9e6a-0d52766749f5_del complete
Oct 20 16:30:08 user nova-compute[74131]: INFO nova.compute.manager [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 16:30:08 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:30:08 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:30:09 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b745a18-2505-4af6-874f-c09de7cdad2c is timed out.
Oct 20 16:30:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully detached device vdb from instance 4b745a18-2505-4af6-874f-c09de7cdad2c from the live domain config.
Oct 20 16:30:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiWjVbhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:30:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f39698-481b-449e-8ba9-adbc394d48f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:30:09 user nova-compute[74131]: No targets found.
Oct 20 16:30:09 user nova-compute[74131]: iSNS:
Oct 20 16:30:09 user nova-compute[74131]: No targets found.
Oct 20 16:30:09 user nova-compute[74131]: STATIC:
Oct 20 16:30:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0
Oct 20 16:30:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:30:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:30:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2
Oct 20 16:30:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:30:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:30:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608
Oct 20 16:30:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:30:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:30:09 user nova-compute[74131]: FIRMWARE:
Oct 20 16:30:09 user nova-compute[74131]: No targets found.
Oct 20 16:30:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:30:09 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:30:09 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0d9979-5f39-4716-be51-1fefa586e4df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a33989-bb47-4917-b7a0-3d0d8803c867]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:09 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:30:09 user nova-compute[74131]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)
Oct 20 16:30:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:09 user nova-compute[74131]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 (non-flash)
Oct 20 16:30:09 user nova-compute[74131]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)
Oct 20 16:30:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e00f6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2'): ({'sdc'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Removing single pathed devices sdc {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3015238-c9a3-4ebf-9b52-be0665011fde]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[902f1fbe-ca3a-4540-aa61-c6a442a5eaf2]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flushing IO for device /dev/sdc {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f09f238-c004-4cc4-8537-9ddd802b18d0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[98435eeb-9759-4307-b3fd-552b6d449442]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[de65403a-b8e0-4fd5-acfc-bd169bb9b832]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d14299e-63e9-4866-83f3-43570860f5a2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260]
Oct 20 16:30:09 user nova-compute[74131]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2, portal: 172.16.0.220,3260] successful.
Oct 20 16:30:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:09 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Took 0.91 seconds to deallocate network for instance.
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba10e328-4236-4c6b-8681-5f77e94bb3d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08cff9-a033-4a07-95f6-0cb2db7d3ad0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== disconnect_volume: return (322ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7470bfd-d8e8-4e81-a91a-3b0c2d5dbcc1 req-4a5c9f37-832b-4ca8-af96-3970db849b1c service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7470bfd-d8e8-4e81-a91a-3b0c2d5dbcc1 req-4a5c9f37-832b-4ca8-af96-3970db849b1c service nova] Acquiring lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7470bfd-d8e8-4e81-a91a-3b0c2d5dbcc1 req-4a5c9f37-832b-4ca8-af96-3970db849b1c service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7470bfd-d8e8-4e81-a91a-3b0c2d5dbcc1 req-4a5c9f37-832b-4ca8-af96-3970db849b1c service nova] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7470bfd-d8e8-4e81-a91a-3b0c2d5dbcc1 req-4a5c9f37-832b-4ca8-af96-3970db849b1c service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] No waiting events found dispatching network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:10 user nova-compute[74131]: WARNING nova.compute.manager [req-a7470bfd-d8e8-4e81-a91a-3b0c2d5dbcc1 req-4a5c9f37-832b-4ca8-af96-3970db849b1c service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received unexpected event network-vif-plugged-b01038b9-456e-4165-9139-f89acc4aecd1 for instance with vm_state deleted and task_state None.
Oct 20 16:30:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7470bfd-d8e8-4e81-a91a-3b0c2d5dbcc1 req-4a5c9f37-832b-4ca8-af96-3970db849b1c service nova] [instance: 9aee3d08-7204-4215-9e6a-0d52766749f5] Received event network-vif-deleted-b01038b9-456e-4165-9139-f89acc4aecd1 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:10 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Deleted allocations for instance 9aee3d08-7204-4215-9e6a-0d52766749f5
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7f366a04-0047-44c8-b92b-dcb52828bfca tempest-TestServerVolumeAttachScenarioOldVersion-390058125 tempest-TestServerVolumeAttachScenarioOldVersion-390058125-project-member] Lock "9aee3d08-7204-4215-9e6a-0d52766749f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 4b745a18-2505-4af6-874f-c09de7cdad2c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ffca7c60-6865-4237-b2bf-9c9221a6fc79 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 is timed out.
Oct 20 16:30:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Successfully detached device vdb from instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 from the live domain config.
Oct 20 16:30:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMUfgiEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:30:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9b5e96-bc6b-40e4-8d83-a772f4e01fae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:30:10 user nova-compute[74131]: No targets found.
Oct 20 16:30:10 user nova-compute[74131]: iSNS:
Oct 20 16:30:10 user nova-compute[74131]: No targets found.
Oct 20 16:30:10 user nova-compute[74131]: STATIC:
Oct 20 16:30:10 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0
Oct 20 16:30:10 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:30:10 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:30:10 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608
Oct 20 16:30:10 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:30:10 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:30:10 user nova-compute[74131]: FIRMWARE:
Oct 20 16:30:10 user nova-compute[74131]: No targets found.
Oct 20 16:30:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:30:10 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:30:10 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ba7209-6b5c-4666-aaf8-ca3ae736283e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[64edc640-31d0-415b-af55-e87e79c443d8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:10 user nova-compute[74131]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)
Oct 20 16:30:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:10 user nova-compute[74131]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 (non-flash)
Oct 20 16:30:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8770e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0'): ({'sdd'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Removing single pathed devices sdd {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37530d-2289-4e08-9cb9-7ae3e357331a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4df933-dea5-4407-91e6-12f7cc74962b]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Flushing IO for device /dev/sdd {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50e57e6-fa87-4e6f-bc4d-455894a88f4c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb528b4-d8fa-4db4-a2ba-3dd96aa7ecaa]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d680b8a-9650-4624-8e53-805306c53b9b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[73edecb4-6778-41c3-b3df-08663a0222b2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260]
Oct 20 16:30:11 user nova-compute[74131]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0, portal: 172.16.0.220,3260] successful.
Oct 20 16:30:11 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d43af997-862f-418f-a9b2-97a2351260e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[942927a7-72c1-4f1e-adaa-19f0acb282be]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] <== disconnect_volume: return (284ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lazy-loading 'flavor' on Instance uuid 5e111d85-bd8d-40b4-b664-8ab924063cb6 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed395ace-33dd-41d7-ba6e-182664e44a8f tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:30:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:30:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:30:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:18 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:30:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:30:21 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Creating image(s)
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Ensure instance console log exists: /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Start _get_guest_xml network_info=[{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '858ede3d-f535-483a-8467-9cd0fc71f178', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUGtmSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0', 'attached_at': '', 'detached_at': '', 'volume_id': '48da990f-1ed3-4d55-b607-f5bb688f72fe', 'serial': '48da990f-1ed3-4d55-b607-f5bb688f72fe'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:30:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUGtmSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:30:21 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:21 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:21 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'pci_requests' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'numa_topology' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac35ae2-0fbf-474d-8187-11f139bc87ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:30:21 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:30:21 user nova-compute[74131]: INFO nova.compute.claims [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Claim successful on node user
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f47429-5b90-417e-90e4-6b56d9865233]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe] added
Oct 20 16:30:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c072f7c-1036-4252-a676-612974cc7aed]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2d5643-5f7c-43ed-8141-f0336c6513d3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUGtmSYA {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUGtmSYA" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f3d0d3-b742-47a8-b9f1-690105543c98]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUGtmSYA'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c7b155-6e2d-4671-baa6-9eff25e5dc66]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a3c9d6-357c-4ecf-a7c2-04e6198bd244]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f81aea-ad84-441e-b1fe-d131b587d194]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260]
Oct 20 16:30:21 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260] successful.
Oct 20 16:30:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943a482-749d-48d6-b4d5-81f5cdd6d918]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1992b-76aa-4d7e-9399-8d91b2b51757]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:21 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:21 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a14fc-a5c8-4929-a5d9-a6c65eb53fc9]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUGtmSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:30:21 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:22 user nova-compute[74131]: INFO nova.network.neutron [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating port 6b904706-24ea-4eb8-93d6-577ddeaef64b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updating instance_info_cache with network_info: [{"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26565353765383439', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565353765383439', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-92896468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-92896468',id=24,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-4pjv3am7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:53Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:30:22 user nova-compute[74131]:   <uuid>3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0</uuid>
Oct 20 16:30:22 user nova-compute[74131]:   <name>instance-00000018</name>
Oct 20 16:30:22 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:30:22 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:30:22 user nova-compute[74131]:   <metadata>
Oct 20 16:30:22 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:30:22 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:30:22 user nova-compute[74131]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-92896468</nova:name>
Oct 20 16:30:22 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:30:21</nova:creationTime>
Oct 20 16:30:22 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:30:22 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:30:22 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:30:22 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:30:22 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:30:22 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:30:22 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:30:22 user nova-compute[74131]:       <nova:owner>
Oct 20 16:30:22 user nova-compute[74131]:         <nova:user uuid="a82534b86e314f00896042e2e684a623">tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member</nova:user>
Oct 20 16:30:22 user nova-compute[74131]:         <nova:project uuid="097a2eccca244cbfa897e6a573a3113d">tempest-ServerBootFromVolumeStableRescueTest-131352591</nova:project>
Oct 20 16:30:22 user nova-compute[74131]:       </nova:owner>
Oct 20 16:30:22 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:30:22 user nova-compute[74131]:       <nova:ports>
Oct 20 16:30:22 user nova-compute[74131]:         <nova:port uuid="464ba822-ba37-482b-9a97-7bea0352d5d3">
Oct 20 16:30:22 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:30:22 user nova-compute[74131]:         </nova:port>
Oct 20 16:30:22 user nova-compute[74131]:       </nova:ports>
Oct 20 16:30:22 user nova-compute[74131]:     </nova:instance>
Oct 20 16:30:22 user nova-compute[74131]:   </metadata>
Oct 20 16:30:22 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:30:22 user nova-compute[74131]:     <system>
Oct 20 16:30:22 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:30:22 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:30:22 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:30:22 user nova-compute[74131]:       <entry name="serial">3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0</entry>
Oct 20 16:30:22 user nova-compute[74131]:       <entry name="uuid">3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0</entry>
Oct 20 16:30:22 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:30:22 user nova-compute[74131]:     </system>
Oct 20 16:30:22 user nova-compute[74131]:   </sysinfo>
Oct 20 16:30:22 user nova-compute[74131]:   <os>
Oct 20 16:30:22 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:30:22 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:30:22 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:30:22 user nova-compute[74131]:   </os>
Oct 20 16:30:22 user nova-compute[74131]:   <features>
Oct 20 16:30:22 user nova-compute[74131]:     <acpi/>
Oct 20 16:30:22 user nova-compute[74131]:     <apic/>
Oct 20 16:30:22 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:30:22 user nova-compute[74131]:   </features>
Oct 20 16:30:22 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:30:22 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:30:22 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:30:22 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:30:22 user nova-compute[74131]:   </clock>
Oct 20 16:30:22 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:30:22 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:30:22 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:30:22 user nova-compute[74131]:   </cpu>
Oct 20 16:30:22 user nova-compute[74131]:   <devices>
Oct 20 16:30:22 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:30:22 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:30:22 user nova-compute[74131]:       <source dev="/dev/sdc"/>
Oct 20 16:30:22 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:30:22 user nova-compute[74131]:       <serial>48da990f-1ed3-4d55-b607-f5bb688f72fe</serial>
Oct 20 16:30:22 user nova-compute[74131]:     </disk>
Oct 20 16:30:22 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:30:22 user nova-compute[74131]:       <mac address="fa:16:3e:c7:90:5d"/>
Oct 20 16:30:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:22 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:30:22 user nova-compute[74131]:       <target dev="tap464ba822-ba"/>
Oct 20 16:30:22 user nova-compute[74131]:     </interface>
Oct 20 16:30:22 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:30:22 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/console.log" append="off"/>
Oct 20 16:30:22 user nova-compute[74131]:     </serial>
Oct 20 16:30:22 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:30:22 user nova-compute[74131]:     <video>
Oct 20 16:30:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:22 user nova-compute[74131]:     </video>
Oct 20 16:30:22 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:30:22 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:30:22 user nova-compute[74131]:     </rng>
Oct 20 16:30:22 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:30:22 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:30:22 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:30:22 user nova-compute[74131]:     </memballoon>
Oct 20 16:30:22 user nova-compute[74131]:   </devices>
Oct 20 16:30:22 user nova-compute[74131]: </domain>
Oct 20 16:30:22 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-92896468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-92896468',id=24,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-4pjv3am7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:53Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG os_vif [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a9b9dea-0258-5161-96ce-8e42c24b5bd5', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap464ba822-ba, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap464ba822-ba, col_values=(('qos', UUID('8589099c-6e83-46b6-8e1c-4edfd4ae624b')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap464ba822-ba, col_values=(('external_ids', {'iface-id': '464ba822-ba37-482b-9a97-7bea0352d5d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:90:5d', 'vm-uuid': '3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:22 user nova-compute[74131]: INFO os_vif [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba')
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquired lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No VIF found with MAC fa:16:3e:c7:90:5d, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing instance network info cache due to event network-changed-6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] Acquiring lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.network.neutron [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Releasing lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:30:23 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Creating image(s)
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'trusted_certs' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] Acquired lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Refreshing network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG nova.objects.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<52b4f002-76fb-45c7-8b60-25c56d40740c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 1.034s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-128dd00a-b4a6-4dfd-aede-2113df75c653 req-a20f370c-0f64-41bb-9854-43d9114c80f9 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-128dd00a-b4a6-4dfd-aede-2113df75c653 req-a20f370c-0f64-41bb-9854-43d9114c80f9 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-128dd00a-b4a6-4dfd-aede-2113df75c653 req-a20f370c-0f64-41bb-9854-43d9114c80f9 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-128dd00a-b4a6-4dfd-aede-2113df75c653 req-a20f370c-0f64-41bb-9854-43d9114c80f9 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-128dd00a-b4a6-4dfd-aede-2113df75c653 req-a20f370c-0f64-41bb-9854-43d9114c80f9 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:24 user nova-compute[74131]: WARNING nova.compute.manager [req-128dd00a-b4a6-4dfd-aede-2113df75c653 req-a20f370c-0f64-41bb-9854-43d9114c80f9 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state building and task_state spawning.
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.part --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG nova.virt.images [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] 9cb9dfeb-0090-471e-9a69-54cd69c9bd33 was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.part /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG nova.network.neutron [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updated VIF entry in instance network info cache for port 6b904706-24ea-4eb8-93d6-577ddeaef64b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG nova.network.neutron [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.part /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.converted" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4db28a97-843b-43ca-a019-7f33aa26d5d3 req-14968a2f-cf74-4252-b1de-4801c549d0c7 service nova] Releasing lock "refresh_cache-52b4f002-76fb-45c7-8b60-25c56d40740c" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.669s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18 --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG nova.objects.instance [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'flavor' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18 --force-share --output=json" returned: 0 in 0.302s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18,backing_fmt=raw /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18,backing_fmt=raw /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk 1073741824" returned: 0 in 0.056s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:25 user nova-compute[74131]: INFO nova.compute.manager [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Attaching volume ce8bf45d-5541-4133-90dc-d3dfb176bcb2 to /dev/vdb
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG os_brick.utils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a2129-47c9-4c1c-aabb-7a75255dc7d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97903eb-a9ab-4ce4-be8d-3e45953808e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18 --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'migration_context' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6424ae17-87a8-421a-b458-0c242019ca09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG nova.objects.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<52b4f002-76fb-45c7-8b60-25c56d40740c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Rebasing disk image.
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7629fa3-cef1-4a55-82b1-0a37312ab44c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:30:26 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8558d2cc-cd51-4386-b34b-e0b97139a6ff]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG os_brick.utils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating existing volume attachment record: 2bfbe684-aa92-4592-a343-4c4ec8d3261a {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e -F raw /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-273bf224-592b-42e8-9c9a-3ab2da30e7d4 req-d7d65fdd-3bd7-4b29-8fb9-c38fd4459b55 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-273bf224-592b-42e8-9c9a-3ab2da30e7d4 req-d7d65fdd-3bd7-4b29-8fb9-c38fd4459b55 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-273bf224-592b-42e8-9c9a-3ab2da30e7d4 req-d7d65fdd-3bd7-4b29-8fb9-c38fd4459b55 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-273bf224-592b-42e8-9c9a-3ab2da30e7d4 req-d7d65fdd-3bd7-4b29-8fb9-c38fd4459b55 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-273bf224-592b-42e8-9c9a-3ab2da30e7d4 req-d7d65fdd-3bd7-4b29-8fb9-c38fd4459b55 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:26 user nova-compute[74131]: WARNING nova.compute.manager [req-273bf224-592b-42e8-9c9a-3ab2da30e7d4 req-d7d65fdd-3bd7-4b29-8fb9-c38fd4459b55 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state building and task_state spawning.
Oct 20 16:30:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:30:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:30:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance spawned successfully.
Oct 20 16:30:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=25.300525665283203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:27 user nova-compute[74131]: INFO nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Took 5.70 seconds to spawn the instance on the hypervisor.
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4b745a18-2505-4af6-874f-c09de7cdad2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 810cb8ab-756c-46df-a052-839812e83ec2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (bae45930-01a8-4277-ad36-8055d9898c12): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:30:27 user nova-compute[74131]: INFO nova.compute.manager [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Took 35.21 seconds to build instance.
Oct 20 16:30:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0de3151f-e59f-4651-b951-5bc0aecd4f7e tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.307s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:30:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e -F raw /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk" returned: 0 in 2.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Ensure instance console log exists: /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Start _get_guest_xml network_info=[{"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='f198fb511d6a6dc219a2dc76887fd335',container_format='bare',created_at=2023-10-20T16:27:33Z,direct_url=<?>,disk_format='qcow2',id=9cb9dfeb-0090-471e-9a69-54cd69c9bd33,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-976985580-shelved',owner='02e81e0cc8c84c22bcb419d79a119364',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T16:27:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '54541ef5-792e-4050-8e19-e6cb2827c4fd', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxwJRIZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '52b4f002-76fb-45c7-8b60-25c56d40740c', 'attached_at': '', 'detached_at': '', 'volume_id': '7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0', 'serial': '7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:30:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f198fb511d6a6dc219a2dc76887fd335',container_format='bare',created_at=2023-10-20T16:27:33Z,direct_url=<?>,disk_format='qcow2',id=9cb9dfeb-0090-471e-9a69-54cd69c9bd33,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-976985580-shelved',owner='02e81e0cc8c84c22bcb419d79a119364',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T16:27:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.objects.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<52b4f002-76fb-45c7-8b60-25c56d40740c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxwJRIZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:30:28 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:28 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:28 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abdc882-01d2-40be-abea-e6c5919624bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:30:28 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24d6a7-a13e-4f96-a08f-7f8b23d88822]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0] added
Oct 20 16:30:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0e4e4-f205-4749-bb88-ff83edbea5f0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[55913ee8-b777-4f76-8a92-4871b65f6dc5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxwJRIZS {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxwJRIZS" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae2dc8e-6988-4e66-bd29-c46fa4f254e2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MxwJRIZS'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c3d701-94ce-4306-824b-287468a44e85]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee59190-b090-4ff7-9c1b-f5e0954abd8c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:28 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:28 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf027e3-ea41-4a4f-a4da-6c6364fcfd08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260]
Oct 20 16:30:28 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260] successful.
Oct 20 16:30:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb0969b-a316-402c-9cfd-147d65182225]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f6e0f0-90f3-462c-b508-7fb120f332e1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:28 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:28 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:28 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:28 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1574ce4-c718-4144-be4b-b4ad8405b252]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:30:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxwJRIZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23733366637326539', 'path': '/dev/sdd'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733366637326539', 'path': '/dev/sdd'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-976985580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-976985580',id=16,image_ref='9cb9dfeb-0090-471e-9a69-54cd69c9bd33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1923835951',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-qaz16zij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member',shelved_at='2023-10-20T16:27:37.874521',shelved_host='user',shelved_image_id='9cb9dfeb-0090-471e-9a69-54cd69c9bd33'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=52b4f002-76fb-45c7-8b60-25c56d40740c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.objects.base [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<52b4f002-76fb-45c7-8b60-25c56d40740c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:30:29 user nova-compute[74131]:   <uuid>52b4f002-76fb-45c7-8b60-25c56d40740c</uuid>
Oct 20 16:30:29 user nova-compute[74131]:   <name>instance-00000010</name>
Oct 20 16:30:29 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:30:29 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:30:29 user nova-compute[74131]:   <metadata>
Oct 20 16:30:29 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:30:29 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:30:29 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-976985580</nova:name>
Oct 20 16:30:29 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:30:28</nova:creationTime>
Oct 20 16:30:29 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:30:29 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:30:29 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:30:29 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:30:29 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:30:29 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:30:29 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:30:29 user nova-compute[74131]:       <nova:owner>
Oct 20 16:30:29 user nova-compute[74131]:         <nova:user uuid="501cfb16d7aa4ef78ea393a53b7aa555">tempest-AttachVolumeShelveTestJSON-189572795-project-member</nova:user>
Oct 20 16:30:29 user nova-compute[74131]:         <nova:project uuid="02e81e0cc8c84c22bcb419d79a119364">tempest-AttachVolumeShelveTestJSON-189572795</nova:project>
Oct 20 16:30:29 user nova-compute[74131]:       </nova:owner>
Oct 20 16:30:29 user nova-compute[74131]:       <nova:root type="image" uuid="9cb9dfeb-0090-471e-9a69-54cd69c9bd33"/>
Oct 20 16:30:29 user nova-compute[74131]:       <nova:ports>
Oct 20 16:30:29 user nova-compute[74131]:         <nova:port uuid="6b904706-24ea-4eb8-93d6-577ddeaef64b">
Oct 20 16:30:29 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 16:30:29 user nova-compute[74131]:         </nova:port>
Oct 20 16:30:29 user nova-compute[74131]:       </nova:ports>
Oct 20 16:30:29 user nova-compute[74131]:     </nova:instance>
Oct 20 16:30:29 user nova-compute[74131]:   </metadata>
Oct 20 16:30:29 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:30:29 user nova-compute[74131]:     <system>
Oct 20 16:30:29 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:30:29 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:30:29 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:30:29 user nova-compute[74131]:       <entry name="serial">52b4f002-76fb-45c7-8b60-25c56d40740c</entry>
Oct 20 16:30:29 user nova-compute[74131]:       <entry name="uuid">52b4f002-76fb-45c7-8b60-25c56d40740c</entry>
Oct 20 16:30:29 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:30:29 user nova-compute[74131]:     </system>
Oct 20 16:30:29 user nova-compute[74131]:   </sysinfo>
Oct 20 16:30:29 user nova-compute[74131]:   <os>
Oct 20 16:30:29 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:30:29 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:30:29 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:30:29 user nova-compute[74131]:   </os>
Oct 20 16:30:29 user nova-compute[74131]:   <features>
Oct 20 16:30:29 user nova-compute[74131]:     <acpi/>
Oct 20 16:30:29 user nova-compute[74131]:     <apic/>
Oct 20 16:30:29 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:30:29 user nova-compute[74131]:   </features>
Oct 20 16:30:29 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:30:29 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:30:29 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:30:29 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:30:29 user nova-compute[74131]:   </clock>
Oct 20 16:30:29 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:30:29 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:30:29 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:30:29 user nova-compute[74131]:   </cpu>
Oct 20 16:30:29 user nova-compute[74131]:   <devices>
Oct 20 16:30:29 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:30:29 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:30:29 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk"/>
Oct 20 16:30:29 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:30:29 user nova-compute[74131]:     </disk>
Oct 20 16:30:29 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:30:29 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:30:29 user nova-compute[74131]:       <source dev="/dev/sdd"/>
Oct 20 16:30:29 user nova-compute[74131]:       <target dev="vdc" bus="virtio"/>
Oct 20 16:30:29 user nova-compute[74131]:       <serial>7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0</serial>
Oct 20 16:30:29 user nova-compute[74131]:     </disk>
Oct 20 16:30:29 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:30:29 user nova-compute[74131]:       <mac address="fa:16:3e:cf:c6:30"/>
Oct 20 16:30:29 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:29 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:30:29 user nova-compute[74131]:       <target dev="tap6b904706-24"/>
Oct 20 16:30:29 user nova-compute[74131]:     </interface>
Oct 20 16:30:29 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:30:29 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/console.log" append="off"/>
Oct 20 16:30:29 user nova-compute[74131]:     </serial>
Oct 20 16:30:29 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:30:29 user nova-compute[74131]:     <video>
Oct 20 16:30:29 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:29 user nova-compute[74131]:     </video>
Oct 20 16:30:29 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:30:29 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:30:29 user nova-compute[74131]:     </rng>
Oct 20 16:30:29 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:30:29 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:30:29 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:30:29 user nova-compute[74131]:     </memballoon>
Oct 20 16:30:29 user nova-compute[74131]:   </devices>
Oct 20 16:30:29 user nova-compute[74131]: </domain>
Oct 20 16:30:29 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-976985580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-976985580',id=16,image_ref='9cb9dfeb-0090-471e-9a69-54cd69c9bd33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1923835951',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-qaz16zij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member',shelved_at='2023-10-20T16:27:37.874521',shelved_host='user',shelved_image_id='9cb9dfeb-0090-471e-9a69-54cd69c9bd33'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=52b4f002-76fb-45c7-8b60-25c56d40740c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG os_vif [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32c090bd-6881-5435-9f03-716f251780e2', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b904706-24, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b904706-24, col_values=(('qos', UUID('07f34e3f-60fc-4594-9577-eb799987a2a1')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b904706-24, col_values=(('external_ids', {'iface-id': '6b904706-24ea-4eb8-93d6-577ddeaef64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c6:30', 'vm-uuid': '52b4f002-76fb-45c7-8b60-25c56d40740c'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:29 user nova-compute[74131]: INFO os_vif [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24')
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No VIF found with MAC fa:16:3e:cf:c6:30, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-cee7aa26-97df-4cc4-ae41-631360af5ffe req-f8e3b4fe-f542-473a-86e8-15c822d8c5b1 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cee7aa26-97df-4cc4-ae41-631360af5ffe req-f8e3b4fe-f542-473a-86e8-15c822d8c5b1 service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cee7aa26-97df-4cc4-ae41-631360af5ffe req-f8e3b4fe-f542-473a-86e8-15c822d8c5b1 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cee7aa26-97df-4cc4-ae41-631360af5ffe req-f8e3b4fe-f542-473a-86e8-15c822d8c5b1 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-cee7aa26-97df-4cc4-ae41-631360af5ffe req-f8e3b4fe-f542-473a-86e8-15c822d8c5b1 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:31 user nova-compute[74131]: WARNING nova.compute.manager [req-cee7aa26-97df-4cc4-ae41-631360af5ffe req-f8e3b4fe-f542-473a-86e8-15c822d8c5b1 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received unexpected event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 16:30:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-79dafd32-909b-4201-a55b-3c7ce3f4e827 req-cf205383-f6c2-46ef-a858-7efea46ccc02 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79dafd32-909b-4201-a55b-3c7ce3f4e827 req-cf205383-f6c2-46ef-a858-7efea46ccc02 service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79dafd32-909b-4201-a55b-3c7ce3f4e827 req-cf205383-f6c2-46ef-a858-7efea46ccc02 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79dafd32-909b-4201-a55b-3c7ce3f4e827 req-cf205383-f6c2-46ef-a858-7efea46ccc02 service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-79dafd32-909b-4201-a55b-3c7ce3f4e827 req-cf205383-f6c2-46ef-a858-7efea46ccc02 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:33 user nova-compute[74131]: WARNING nova.compute.manager [req-79dafd32-909b-4201-a55b-3c7ce3f4e827 req-cf205383-f6c2-46ef-a858-7efea46ccc02 service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received unexpected event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 16:30:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:30:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:30:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance spawned successfully.
Oct 20 16:30:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:30:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4d8e887d-36e6-4a86-b390-658b9cb6b4d0 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 68.158s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:39 user nova-compute[74131]: INFO nova.compute.manager [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Terminating instance
Oct 20 16:30:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-f32d0e16-9a40-4294-82ef-6bd110bcc892 req-40240b47-74bd-4498-9ca3-84e10921d593 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-vif-unplugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f32d0e16-9a40-4294-82ef-6bd110bcc892 req-40240b47-74bd-4498-9ca3-84e10921d593 service nova] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f32d0e16-9a40-4294-82ef-6bd110bcc892 req-40240b47-74bd-4498-9ca3-84e10921d593 service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f32d0e16-9a40-4294-82ef-6bd110bcc892 req-40240b47-74bd-4498-9ca3-84e10921d593 service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-f32d0e16-9a40-4294-82ef-6bd110bcc892 req-40240b47-74bd-4498-9ca3-84e10921d593 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] No waiting events found dispatching network-vif-unplugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-f32d0e16-9a40-4294-82ef-6bd110bcc892 req-40240b47-74bd-4498-9ca3-84e10921d593 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-vif-unplugged-7a8f5260-8511-466c-b422-3e6156d8b3cc for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:40 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Instance destroyed successfully.
Oct 20 16:30:40 user nova-compute[74131]: DEBUG nova.objects.instance [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'resources' on Instance uuid 4b745a18-2505-4af6-874f-c09de7cdad2c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1043008733',display_name='tempest-AttachVolumeNegativeTest-server-1043008733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1043008733',id=20,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvINOuU21efj8A/0FLSAwLVIcuzoshiC1Rnbfodz+qRAcfz8jlIneA/3vNKlD8CyYe1Wc0fjdfcNmJZRqWqfEoTKCHyQL6BqeHuZbg8XB01UFrGqjlhfz0wlzmlFy4+Hw==',key_name='tempest-keypair-578989018',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:27:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-3ue8pwog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=4b745a18-2505-4af6-874f-c09de7cdad2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "address": "fa:16:3e:42:82:34", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8f5260-85", "ovs_interfaceid": "7a8f5260-8511-466c-b422-3e6156d8b3cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:34,bridge_name='br-int',has_traffic_filtering=True,id=7a8f5260-8511-466c-b422-3e6156d8b3cc,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8f5260-85') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG os_vif [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:34,bridge_name='br-int',has_traffic_filtering=True,id=7a8f5260-8511-466c-b422-3e6156d8b3cc,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8f5260-85') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a8f5260-85, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10806012-d74c-4a26-a0d1-2761f92c591a) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:40 user nova-compute[74131]: INFO os_vif [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:34,bridge_name='br-int',has_traffic_filtering=True,id=7a8f5260-8511-466c-b422-3e6156d8b3cc,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8f5260-85')
Oct 20 16:30:40 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Deleting instance files /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c_del
Oct 20 16:30:40 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Deletion of /opt/stack/data/nova/instances/4b745a18-2505-4af6-874f-c09de7cdad2c_del complete
Oct 20 16:30:40 user nova-compute[74131]: INFO nova.compute.manager [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 16:30:40 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:30:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-88859dc9-409c-4a10-968e-429613ce955c req-ceba5a3e-4713-48df-8ff0-e680a2d5d150 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88859dc9-409c-4a10-968e-429613ce955c req-ceba5a3e-4713-48df-8ff0-e680a2d5d150 service nova] Acquiring lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88859dc9-409c-4a10-968e-429613ce955c req-ceba5a3e-4713-48df-8ff0-e680a2d5d150 service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88859dc9-409c-4a10-968e-429613ce955c req-ceba5a3e-4713-48df-8ff0-e680a2d5d150 service nova] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-88859dc9-409c-4a10-968e-429613ce955c req-ceba5a3e-4713-48df-8ff0-e680a2d5d150 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] No waiting events found dispatching network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:41 user nova-compute[74131]: WARNING nova.compute.manager [req-88859dc9-409c-4a10-968e-429613ce955c req-ceba5a3e-4713-48df-8ff0-e680a2d5d150 service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received unexpected event network-vif-plugged-7a8f5260-8511-466c-b422-3e6156d8b3cc for instance with vm_state active and task_state deleting.
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "42233b10-3752-4adf-89de-7ebe52bd1e02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:30:41 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Took 1.63 seconds to deallocate network for instance.
Oct 20 16:30:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-f74f1467-a9d8-495f-8182-9d035d5e3da2 req-7cc71568-0d89-4347-ba18-a2d576b863af service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Received event network-vif-deleted-7a8f5260-8511-466c-b422-3e6156d8b3cc {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:41 user nova-compute[74131]: INFO nova.compute.manager [req-f74f1467-a9d8-495f-8182-9d035d5e3da2 req-7cc71568-0d89-4347-ba18-a2d576b863af service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Neutron deleted interface 7a8f5260-8511-466c-b422-3e6156d8b3cc; detaching it from the instance and deleting it from the info cache
Oct 20 16:30:41 user nova-compute[74131]: DEBUG nova.network.neutron [req-f74f1467-a9d8-495f-8182-9d035d5e3da2 req-7cc71568-0d89-4347-ba18-a2d576b863af service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-f74f1467-a9d8-495f-8182-9d035d5e3da2 req-7cc71568-0d89-4347-ba18-a2d576b863af service nova] [instance: 4b745a18-2505-4af6-874f-c09de7cdad2c] Detach interface failed, port_id=7a8f5260-8511-466c-b422-3e6156d8b3cc, reason: Instance 4b745a18-2505-4af6-874f-c09de7cdad2c could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.369s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:30:42 user nova-compute[74131]: INFO nova.compute.claims [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Claim successful on node user
Oct 20 16:30:42 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Deleted allocations for instance 4b745a18-2505-4af6-874f-c09de7cdad2c
Oct 20 16:30:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1b22d860-0ee9-4707-8cae-f1aa2c5cc6a0 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "4b745a18-2505-4af6-874f-c09de7cdad2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.189s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:30:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:30:42 user nova-compute[74131]: DEBUG nova.policy [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27db8d4c54ec453b95a9a0de35d18fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfddd1bd2cd4dde9c2fede4e4d6aa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:30:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Creating image(s)
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "/opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "/opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "/opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk 1073741824" returned: 0 in 0.058s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Successfully created port: db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Cannot resize image /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Ensure instance console log exists: /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Successfully updated port: db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "refresh_cache-42233b10-3752-4adf-89de-7ebe52bd1e02" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquired lock "refresh_cache-42233b10-3752-4adf-89de-7ebe52bd1e02" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received event network-changed-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Refreshing instance network info cache due to event network-changed-db82a2a6-d338-44f7-9930-789831fda427. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] Acquiring lock "refresh_cache-42233b10-3752-4adf-89de-7ebe52bd1e02" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Updating instance_info_cache with network_info: [{"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Releasing lock "refresh_cache-42233b10-3752-4adf-89de-7ebe52bd1e02" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Instance network_info: |[{"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] Acquired lock "refresh_cache-42233b10-3752-4adf-89de-7ebe52bd1e02" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Refreshing network info cache for port db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Start _get_guest_xml network_info=[{"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:30:44 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:44 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-999764633',display_name='tempest-VolumesAdminNegativeTest-server-999764633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-999764633',id=25,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dfddd1bd2cd4dde9c2fede4e4d6aa00',ramdisk_id='',reservation_id='r-befh1yt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-651596449',owner_user_name='tempest-VolumesAdminNegativeTest-651596449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:30:43Z,user_data=None,user_id='27db8d4c54ec453b95a9a0de35d18fe3',uuid=42233b10-3752-4adf-89de-7ebe52bd1e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converting VIF {"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:71,bridge_name='br-int',has_traffic_filtering=True,id=db82a2a6-d338-44f7-9930-789831fda427,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb82a2a6-d3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.objects.instance [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lazy-loading 'pci_devices' on Instance uuid 42233b10-3752-4adf-89de-7ebe52bd1e02 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:30:44 user nova-compute[74131]:   <uuid>42233b10-3752-4adf-89de-7ebe52bd1e02</uuid>
Oct 20 16:30:44 user nova-compute[74131]:   <name>instance-00000019</name>
Oct 20 16:30:44 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:30:44 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:30:44 user nova-compute[74131]:   <metadata>
Oct 20 16:30:44 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:30:44 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:30:44 user nova-compute[74131]:       <nova:name>tempest-VolumesAdminNegativeTest-server-999764633</nova:name>
Oct 20 16:30:44 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:30:44</nova:creationTime>
Oct 20 16:30:44 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:30:44 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:30:44 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:30:44 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:30:44 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:30:44 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:30:44 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:30:44 user nova-compute[74131]:       <nova:owner>
Oct 20 16:30:44 user nova-compute[74131]:         <nova:user uuid="27db8d4c54ec453b95a9a0de35d18fe3">tempest-VolumesAdminNegativeTest-651596449-project-member</nova:user>
Oct 20 16:30:44 user nova-compute[74131]:         <nova:project uuid="4dfddd1bd2cd4dde9c2fede4e4d6aa00">tempest-VolumesAdminNegativeTest-651596449</nova:project>
Oct 20 16:30:44 user nova-compute[74131]:       </nova:owner>
Oct 20 16:30:44 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:30:44 user nova-compute[74131]:       <nova:ports>
Oct 20 16:30:44 user nova-compute[74131]:         <nova:port uuid="db82a2a6-d338-44f7-9930-789831fda427">
Oct 20 16:30:44 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 16:30:44 user nova-compute[74131]:         </nova:port>
Oct 20 16:30:44 user nova-compute[74131]:       </nova:ports>
Oct 20 16:30:44 user nova-compute[74131]:     </nova:instance>
Oct 20 16:30:44 user nova-compute[74131]:   </metadata>
Oct 20 16:30:44 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:30:44 user nova-compute[74131]:     <system>
Oct 20 16:30:44 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:30:44 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:30:44 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:30:44 user nova-compute[74131]:       <entry name="serial">42233b10-3752-4adf-89de-7ebe52bd1e02</entry>
Oct 20 16:30:44 user nova-compute[74131]:       <entry name="uuid">42233b10-3752-4adf-89de-7ebe52bd1e02</entry>
Oct 20 16:30:44 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:30:44 user nova-compute[74131]:     </system>
Oct 20 16:30:44 user nova-compute[74131]:   </sysinfo>
Oct 20 16:30:44 user nova-compute[74131]:   <os>
Oct 20 16:30:44 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:30:44 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:30:44 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:30:44 user nova-compute[74131]:   </os>
Oct 20 16:30:44 user nova-compute[74131]:   <features>
Oct 20 16:30:44 user nova-compute[74131]:     <acpi/>
Oct 20 16:30:44 user nova-compute[74131]:     <apic/>
Oct 20 16:30:44 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:30:44 user nova-compute[74131]:   </features>
Oct 20 16:30:44 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:30:44 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:30:44 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:30:44 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:30:44 user nova-compute[74131]:   </clock>
Oct 20 16:30:44 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:30:44 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:30:44 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:30:44 user nova-compute[74131]:   </cpu>
Oct 20 16:30:44 user nova-compute[74131]:   <devices>
Oct 20 16:30:44 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:30:44 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:30:44 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk"/>
Oct 20 16:30:44 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:30:44 user nova-compute[74131]:     </disk>
Oct 20 16:30:44 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:30:44 user nova-compute[74131]:       <mac address="fa:16:3e:65:88:71"/>
Oct 20 16:30:44 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:44 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:30:44 user nova-compute[74131]:       <target dev="tapdb82a2a6-d3"/>
Oct 20 16:30:44 user nova-compute[74131]:     </interface>
Oct 20 16:30:44 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:30:44 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/console.log" append="off"/>
Oct 20 16:30:44 user nova-compute[74131]:     </serial>
Oct 20 16:30:44 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:30:44 user nova-compute[74131]:     <video>
Oct 20 16:30:44 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:44 user nova-compute[74131]:     </video>
Oct 20 16:30:44 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:30:44 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:30:44 user nova-compute[74131]:     </rng>
Oct 20 16:30:44 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:30:44 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:30:44 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:30:44 user nova-compute[74131]:     </memballoon>
Oct 20 16:30:44 user nova-compute[74131]:   </devices>
Oct 20 16:30:44 user nova-compute[74131]: </domain>
Oct 20 16:30:44 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-999764633',display_name='tempest-VolumesAdminNegativeTest-server-999764633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-999764633',id=25,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dfddd1bd2cd4dde9c2fede4e4d6aa00',ramdisk_id='',reservation_id='r-befh1yt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-651596449',owner_user_name='tempest-VolumesAdminNegativeTest-651596449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:30:43Z,user_data=None,user_id='27db8d4c54ec453b95a9a0de35d18fe3',uuid=42233b10-3752-4adf-89de-7ebe52bd1e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converting VIF {"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:71,bridge_name='br-int',has_traffic_filtering=True,id=db82a2a6-d338-44f7-9930-789831fda427,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb82a2a6-d3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG os_vif [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:71,bridge_name='br-int',has_traffic_filtering=True,id=db82a2a6-d338-44f7-9930-789831fda427,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb82a2a6-d3') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc32a2c1-7d36-5060-a94c-59b96aaa104e', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb82a2a6-d3, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb82a2a6-d3, col_values=(('qos', UUID('4b8bf2ce-62aa-44c8-b149-c13007e38a4e')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb82a2a6-d3, col_values=(('external_ids', {'iface-id': 'db82a2a6-d338-44f7-9930-789831fda427', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:88:71', 'vm-uuid': '42233b10-3752-4adf-89de-7ebe52bd1e02'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:44 user nova-compute[74131]: INFO os_vif [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:71,bridge_name='br-int',has_traffic_filtering=True,id=db82a2a6-d338-44f7-9930-789831fda427,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb82a2a6-d3')
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] No VIF found with MAC fa:16:3e:65:88:71, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:30:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Updated VIF entry in instance network info cache for port db82a2a6-d338-44f7-9930-789831fda427. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Updating instance_info_cache with network_info: [{"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecfa523c-0cbf-4923-ae00-634661cc0047 req-c9e13c0c-bebe-41f0-b07c-de8dbf79d3d0 service nova] Releasing lock "refresh_cache-42233b10-3752-4adf-89de-7ebe52bd1e02" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOTFRESG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:30:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:45 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42db089-4dd7-4f75-96b8-d991e187558f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:30:45 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[28797000-615f-43a8-ae3f-a74e08090715]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2] added
Oct 20 16:30:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1796219e-ed2b-4488-a23c-4ee04a4559dc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca8c0e-9776-4f14-8462-6114e17ec94b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOTFRESG {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOTFRESG" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc1e56-1503-46e2-ac63-36f153502cf4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOTFRESG'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c90401d-fa53-4e57-8ad3-e79ac25b3d5b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dec3e6-7617-4274-b705-70694653736d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6cbf6-a19a-46bc-81c8-07fbd98a9e4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260]
Oct 20 16:30:45 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260] successful.
Oct 20 16:30:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b040820f-a7e7-4ecb-b755-90ae4ae6b226]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ead70b-bc49-48a5-bd12-85aa6eaa2ab7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:30:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5b7d9c-811f-4845-b94d-84b9e0ef55c9]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOTFRESG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26438666636383562', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438666636383562', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'flavor' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:30:46 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:30:46 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:30:46 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:30:46 user nova-compute[74131]:   <serial>ce8bf45d-5541-4133-90dc-d3dfb176bcb2</serial>
Oct 20 16:30:46 user nova-compute[74131]: </disk>
Oct 20 16:30:46 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No VIF found with MAC fa:16:3e:97:63:35, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55f78f22-57c0-4ffa-8b4d-5cf8c96ad327 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.598s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a085dbea-8ed9-4dd2-86fe-0878b229f0c0 req-65315d72-2488-46b8-8666-dbe41a7991a8 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received event network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a085dbea-8ed9-4dd2-86fe-0878b229f0c0 req-65315d72-2488-46b8-8666-dbe41a7991a8 service nova] Acquiring lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a085dbea-8ed9-4dd2-86fe-0878b229f0c0 req-65315d72-2488-46b8-8666-dbe41a7991a8 service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a085dbea-8ed9-4dd2-86fe-0878b229f0c0 req-65315d72-2488-46b8-8666-dbe41a7991a8 service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a085dbea-8ed9-4dd2-86fe-0878b229f0c0 req-65315d72-2488-46b8-8666-dbe41a7991a8 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] No waiting events found dispatching network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:47 user nova-compute[74131]: WARNING nova.compute.manager [req-a085dbea-8ed9-4dd2-86fe-0878b229f0c0 req-65315d72-2488-46b8-8666-dbe41a7991a8 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received unexpected event network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 for instance with vm_state building and task_state spawning.
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:30:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Instance spawned successfully.
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:30:48 user nova-compute[74131]: INFO nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:30:48 user nova-compute[74131]: INFO nova.compute.manager [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Took 6.75 seconds to build instance.
Oct 20 16:30:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21bb5644-e06c-45fa-ac9e-959d9cacf161 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.861s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:48 user nova-compute[74131]: INFO nova.compute.manager [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Rescuing
Oct 20 16:30:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:30:48 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c49dbdf7-c4b8-402e-8c42-ac37fe34c768 req-8821be78-386b-475e-a707-f34b329bdbfd service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received event network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c49dbdf7-c4b8-402e-8c42-ac37fe34c768 req-8821be78-386b-475e-a707-f34b329bdbfd service nova] Acquiring lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c49dbdf7-c4b8-402e-8c42-ac37fe34c768 req-8821be78-386b-475e-a707-f34b329bdbfd service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c49dbdf7-c4b8-402e-8c42-ac37fe34c768 req-8821be78-386b-475e-a707-f34b329bdbfd service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-c49dbdf7-c4b8-402e-8c42-ac37fe34c768 req-8821be78-386b-475e-a707-f34b329bdbfd service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] No waiting events found dispatching network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:49 user nova-compute[74131]: WARNING nova.compute.manager [req-c49dbdf7-c4b8-402e-8c42-ac37fe34c768 req-8821be78-386b-475e-a707-f34b329bdbfd service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received unexpected event network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 for instance with vm_state active and task_state None.
Oct 20 16:30:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance destroyed successfully.
Oct 20 16:30:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Attempting a stable device rescue
Oct 20 16:30:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74131) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 16:30:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:30:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Creating image(s)
Oct 20 16:30:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:50 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "28406df8404652d0de3274e8f2192953f7d33d84" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "28406df8404652d0de3274e8f2192953f7d33d84" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.part --force-share --output=json" returned: 0 in 0.218s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG nova.virt.images [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] 9150f5cc-294a-4d8c-b3e9-08d9c87fb0b2 was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.part /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:51 user nova-compute[74131]: WARNING nova.compute.manager [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state active and task_state rescuing.
Oct 20 16:30:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:51 user nova-compute[74131]: WARNING nova.compute.manager [req-2b0d74c4-dfeb-4028-b799-bec39df301fb req-374ce711-59e5-4a4b-a5b2-1a96ad9fd7de service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state active and task_state rescuing.
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.part /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.converted" returned: 0 in 0.385s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "28406df8404652d0de3274e8f2192953f7d33d84" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.619s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "28406df8404652d0de3274e8f2192953f7d33d84" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "28406df8404652d0de3274e8f2192953f7d33d84" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84 --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84,backing_fmt=raw /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84,backing_fmt=raw /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue" returned: 0 in 0.049s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "28406df8404652d0de3274e8f2192953f7d33d84" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'migration_context' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Object Instance<9ff2e5d8-f854-4f8b-941f-17ba5e47caff> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Start _get_guest_xml network_info=[{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "vif_mac": "fa:16:3e:97:63:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9150f5cc-294a-4d8c-b3e9-08d9c87fb0b2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2bfbe684-aa92-4592-a343-4c4ec8d3261a', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOTFRESG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9ff2e5d8-f854-4f8b-941f-17ba5e47caff', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 'serial': 'ce8bf45d-5541-4133-90dc-d3dfb176bcb2'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'resources' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Object Instance<9ff2e5d8-f854-4f8b-941f-17ba5e47caff> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Object Instance<9ff2e5d8-f854-4f8b-941f-17ba5e47caff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:52 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:52 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Object Instance<9ff2e5d8-f854-4f8b-941f-17ba5e47caff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOTFRESG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:30:52 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:52 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:30:52 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699b2b4-5e05-4962-be2b-7fb7782a8f27]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LOTFRESG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 16:30:52 user nova-compute[74131]: node.name = iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:30:52 user nova-compute[74131]: node.tpgt = -1
Oct 20 16:30:52 user nova-compute[74131]: node.startup = automatic
Oct 20 16:30:52 user nova-compute[74131]: node.leading_login = No
Oct 20 16:30:52 user nova-compute[74131]: iface.iscsi_ifacename = default
Oct 20 16:30:52 user nova-compute[74131]: iface.net_ifacename = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.ipaddress = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.prefix_len = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.hwaddress = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.transport_name = tcp
Oct 20 16:30:52 user nova-compute[74131]: iface.initiatorname = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.state = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.vlan_id = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.vlan_priority = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.vlan_state = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.iface_num = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.mtu = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.port = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.bootproto = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.subnet_mask = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.gateway = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_alt_client_id = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_dns = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_learn_iqn = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_vendor_id_state = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_vendor_id = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.dhcp_slp_da = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.fragmentation = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.gratuitous_arp = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.incoming_forwarding = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.tos_state = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.tos = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.ttl = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.delayed_ack = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.tcp_nagle = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.tcp_wsf_state = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.tcp_wsf = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.tcp_timer_scale = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.tcp_timestamp = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.redirect = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.def_task_mgmt_timeout = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.header_digest = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.data_digest = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.immediate_data = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.initial_r2t = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.data_seq_inorder = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.data_pdu_inorder = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.erl = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.max_receive_data_len = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.first_burst_len = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.max_outstanding_r2t = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.max_burst_len = 0
Oct 20 16:30:52 user nova-compute[74131]: iface.chap_auth = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.bidi_chap = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.strict_login_compliance = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.discovery_auth = <empty>
Oct 20 16:30:52 user nova-compute[74131]: iface.discovery_logout = <empty>
Oct 20 16:30:52 user nova-compute[74131]: node.discovery_address = <empty>
Oct 20 16:30:52 user nova-compute[74131]: node.discovery_port = 0
Oct 20 16:30:52 user nova-compute[74131]: node.discovery_type = static
Oct 20 16:30:52 user nova-compute[74131]: node.session.initial_cmdsn = 0
Oct 20 16:30:52 user nova-compute[74131]: node.session.initial_login_retry_max = 8
Oct 20 16:30:52 user nova-compute[74131]: node.session.xmit_thread_priority = -20
Oct 20 16:30:52 user nova-compute[74131]: node.session.cmds_max = 128
Oct 20 16:30:52 user nova-compute[74131]: node.session.queue_depth = 32
Oct 20 16:30:52 user nova-compute[74131]: node.session.nr_sessions = 1
Oct 20 16:30:52 user nova-compute[74131]: node.session.auth.authmethod = CHAP
Oct 20 16:30:52 user nova-compute[74131]: node.session.auth.username = LOTFRESG
Oct 20 16:30:52 user nova-compute[74131]: node.session.auth.password = ***
Oct 20 16:30:52 user nova-compute[74131]: node.session.auth.username_in = <empty>
Oct 20 16:30:52 user nova-compute[74131]: node.session.auth.password_in = <empty>
Oct 20 16:30:52 user nova-compute[74131]: node.session.auth.chap_algs = MD5
Oct 20 16:30:52 user nova-compute[74131]: node.session.timeo.replacement_timeout = 120
Oct 20 16:30:52 user nova-compute[74131]: node.session.err_timeo.abort_timeout = 15
Oct 20 16:30:52 user nova-compute[74131]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 16:30:52 user nova-compute[74131]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 16:30:52 user nova-compute[74131]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.FastAbort = Yes
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.InitialR2T = No
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.ImmediateData = Yes
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.MaxConnections = 1
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 16:30:52 user nova-compute[74131]: node.session.iscsi.ERL = 0
Oct 20 16:30:52 user nova-compute[74131]: node.session.scan = manual
Oct 20 16:30:52 user nova-compute[74131]: node.session.reopen_max = 0
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].address = 172.16.0.220
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].port = 3260
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].startup = manual
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].tcp.window_size = 524288
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].tcp.type_of_service = 0
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].timeo.logout_timeout = 15
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].timeo.login_timeout = 15
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].timeo.auth_timeout = 45
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].iscsi.DataDigest = None
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].iscsi.IFMarker = No
Oct 20 16:30:52 user nova-compute[74131]: node.conn[0].iscsi.OFMarker = No
Oct 20 16:30:52 user nova-compute[74131]: # END RECORD
Oct 20 16:30:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf53693-30ed-401e-8e4a-43e88dcf6dd0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5e372-8205-4059-b8c0-43af79983684]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOTFRESG {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOTFRESG" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4add53-69f0-4d75-b1cc-fcdbf03b4fc3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOTFRESG'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[728286c4-fd72-43fd-9c94-fd8314de0f33]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2cdd6d-9806-41a0-8fb3-6463e189b501]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:52 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:52 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:52 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:30:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:30:52 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:30:52 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:30:52 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:30:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.151s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] HCTL ('36', '0', '0', 0) found on session 27 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf90fd-07ac-45b0-b811-1606c6abb51b]: (4, ('0 0 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Searching for a device in session 27 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOTFRESG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '26438666636383562', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438666636383562', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-447823817',display_name='tempest-ServerStableDeviceRescueTest-server-447823817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-447823817',id=17,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFncVUjULMjWlv7/khPkG+gUk9kJKtqLh6194ST9QWIhoqdt30J9vNE2m2+X8p5mbqpA2A0wOS2CLlIf6kljzOofXEo0C8y6Vx/aPVzgsfijCalCmczjb5nqXPiG4INkw==',key_name='tempest-keypair-392604751',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:26:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff11d09248b04962964ad7f47275a2d5',ramdisk_id='',reservation_id='r-vpxn1dqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-472624141',owner_user_name='tempest-ServerStableDeviceRescueTest-472624141-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a97cc9f5e947c19c91e9f39a3ff550',uuid=9ff2e5d8-f854-4f8b-941f-17ba5e47caff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "vif_mac": "fa:16:3e:97:63:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converting VIF {"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "vif_mac": "fa:16:3e:97:63:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.objects.base [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Object Instance<9ff2e5d8-f854-4f8b-941f-17ba5e47caff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:30:52 user nova-compute[74131]:   <uuid>9ff2e5d8-f854-4f8b-941f-17ba5e47caff</uuid>
Oct 20 16:30:52 user nova-compute[74131]:   <name>instance-00000011</name>
Oct 20 16:30:52 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:30:52 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:30:52 user nova-compute[74131]:   <metadata>
Oct 20 16:30:52 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:30:52 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:30:52 user nova-compute[74131]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-447823817</nova:name>
Oct 20 16:30:52 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:30:52</nova:creationTime>
Oct 20 16:30:52 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:30:52 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:30:52 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:30:52 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:30:52 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:30:52 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:30:52 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:30:52 user nova-compute[74131]:       <nova:owner>
Oct 20 16:30:52 user nova-compute[74131]:         <nova:user uuid="72a97cc9f5e947c19c91e9f39a3ff550">tempest-ServerStableDeviceRescueTest-472624141-project-member</nova:user>
Oct 20 16:30:52 user nova-compute[74131]:         <nova:project uuid="ff11d09248b04962964ad7f47275a2d5">tempest-ServerStableDeviceRescueTest-472624141</nova:project>
Oct 20 16:30:52 user nova-compute[74131]:       </nova:owner>
Oct 20 16:30:52 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:30:52 user nova-compute[74131]:       <nova:ports>
Oct 20 16:30:52 user nova-compute[74131]:         <nova:port uuid="3058f4d2-f621-46ec-b677-b5161dba512f">
Oct 20 16:30:52 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 16:30:52 user nova-compute[74131]:         </nova:port>
Oct 20 16:30:52 user nova-compute[74131]:       </nova:ports>
Oct 20 16:30:52 user nova-compute[74131]:     </nova:instance>
Oct 20 16:30:52 user nova-compute[74131]:   </metadata>
Oct 20 16:30:52 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:30:52 user nova-compute[74131]:     <system>
Oct 20 16:30:52 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:30:52 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:30:52 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:30:52 user nova-compute[74131]:       <entry name="serial">9ff2e5d8-f854-4f8b-941f-17ba5e47caff</entry>
Oct 20 16:30:52 user nova-compute[74131]:       <entry name="uuid">9ff2e5d8-f854-4f8b-941f-17ba5e47caff</entry>
Oct 20 16:30:52 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:30:52 user nova-compute[74131]:     </system>
Oct 20 16:30:52 user nova-compute[74131]:   </sysinfo>
Oct 20 16:30:52 user nova-compute[74131]:   <os>
Oct 20 16:30:52 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:30:52 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:30:52 user nova-compute[74131]:   </os>
Oct 20 16:30:52 user nova-compute[74131]:   <features>
Oct 20 16:30:52 user nova-compute[74131]:     <acpi/>
Oct 20 16:30:52 user nova-compute[74131]:     <apic/>
Oct 20 16:30:52 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:30:52 user nova-compute[74131]:   </features>
Oct 20 16:30:52 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:30:52 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:30:52 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:30:52 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:30:52 user nova-compute[74131]:   </clock>
Oct 20 16:30:52 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:30:52 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:30:52 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:30:52 user nova-compute[74131]:   </cpu>
Oct 20 16:30:52 user nova-compute[74131]:   <devices>
Oct 20 16:30:52 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:30:52 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:30:52 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk"/>
Oct 20 16:30:52 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:30:52 user nova-compute[74131]:     </disk>
Oct 20 16:30:52 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:30:52 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:30:52 user nova-compute[74131]:       <source dev="/dev/sde"/>
Oct 20 16:30:52 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:30:52 user nova-compute[74131]:       <serial>ce8bf45d-5541-4133-90dc-d3dfb176bcb2</serial>
Oct 20 16:30:52 user nova-compute[74131]:     </disk>
Oct 20 16:30:52 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:30:52 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:30:52 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue"/>
Oct 20 16:30:52 user nova-compute[74131]:       <target dev="vdc" bus="virtio"/>
Oct 20 16:30:52 user nova-compute[74131]:       <boot order="1"/>
Oct 20 16:30:52 user nova-compute[74131]:     </disk>
Oct 20 16:30:52 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:30:52 user nova-compute[74131]:       <mac address="fa:16:3e:97:63:35"/>
Oct 20 16:30:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:52 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:30:52 user nova-compute[74131]:       <target dev="tap3058f4d2-f6"/>
Oct 20 16:30:52 user nova-compute[74131]:     </interface>
Oct 20 16:30:52 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:30:52 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/console.log" append="off"/>
Oct 20 16:30:52 user nova-compute[74131]:     </serial>
Oct 20 16:30:52 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:30:52 user nova-compute[74131]:     <video>
Oct 20 16:30:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:30:52 user nova-compute[74131]:     </video>
Oct 20 16:30:52 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:30:52 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:30:52 user nova-compute[74131]:     </rng>
Oct 20 16:30:52 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:30:52 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:30:52 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:30:52 user nova-compute[74131]:     </memballoon>
Oct 20 16:30:52 user nova-compute[74131]:   </devices>
Oct 20 16:30:52 user nova-compute[74131]: </domain>
Oct 20 16:30:52 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:30:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance destroyed successfully.
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:30:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] No VIF found with MAC fa:16:3e:97:63:35, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-1707188c-2990-41ba-ac31-e095bc52337f req-6dd590a2-1609-40df-b6a1-44bafb5eeba4 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1707188c-2990-41ba-ac31-e095bc52337f req-6dd590a2-1609-40df-b6a1-44bafb5eeba4 service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1707188c-2990-41ba-ac31-e095bc52337f req-6dd590a2-1609-40df-b6a1-44bafb5eeba4 service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1707188c-2990-41ba-ac31-e095bc52337f req-6dd590a2-1609-40df-b6a1-44bafb5eeba4 service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-1707188c-2990-41ba-ac31-e095bc52337f req-6dd590a2-1609-40df-b6a1-44bafb5eeba4 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:54 user nova-compute[74131]: WARNING nova.compute.manager [req-1707188c-2990-41ba-ac31-e095bc52337f req-6dd590a2-1609-40df-b6a1-44bafb5eeba4 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state active and task_state rescuing.
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-8559a8d5-4b84-4901-b83b-3e1a4ef0df05 req-c7489425-85df-45e7-86fe-eb5750617fce service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:30:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8559a8d5-4b84-4901-b83b-3e1a4ef0df05 req-c7489425-85df-45e7-86fe-eb5750617fce service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:30:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8559a8d5-4b84-4901-b83b-3e1a4ef0df05 req-c7489425-85df-45e7-86fe-eb5750617fce service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:30:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8559a8d5-4b84-4901-b83b-3e1a4ef0df05 req-c7489425-85df-45e7-86fe-eb5750617fce service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:30:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-8559a8d5-4b84-4901-b83b-3e1a4ef0df05 req-c7489425-85df-45e7-86fe-eb5750617fce service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:30:56 user nova-compute[74131]: WARNING nova.compute.manager [req-8559a8d5-4b84-4901-b83b-3e1a4ef0df05 req-c7489425-85df-45e7-86fe-eb5750617fce service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state active and task_state rescuing.
Oct 20 16:30:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f33a4813-adee-48f8-a331-6fac93e93ecd tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:30:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:30:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:31:06 user nova-compute[74131]: INFO nova.compute.claims [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Claim successful on node user
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.network.neutron [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:31:06 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:31:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:31:07 user nova-compute[74131]: INFO nova.virt.block_device [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Booting with volume 67480b9d-ee42-44ae-bb15-41c5ecb1dc01 at /dev/vda
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.policy [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059cd89b482d4205a8d7f5a32037afd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce29bcf6e2431a92d345a3e739f81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-changed-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Refreshing instance network info cache due to event network-changed-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] Acquiring lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] Acquired lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.network.neutron [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Refreshing network info cache for port 9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG os_brick.utils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cd047-ab24-4109-a03e-5100f38647ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46e9071-7ee2-473f-b9fd-19cdbad14325]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.057s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a41fb8-6bb4-42b7-9894-8f75f3435fad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[575f2942-ace7-4ae4-a905-dbcb9d53c23a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:31:07 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f36f00e-1fc8-4c51-bbe5-bdc2b97c8589]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG os_brick.utils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating existing volume attachment record: c65accda-7de6-4609-a350-3c06ea4c6647 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.network.neutron [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updated VIF entry in instance network info cache for port 9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.network.neutron [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating instance_info_cache with network_info: [{"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ccdc6d5d-601b-4758-b5d4-7580772326dd req-7ba54788-95e5-48fe-898b-62ff7b6c38bc service nova] Releasing lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG nova.objects.instance [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'flavor' on Instance uuid 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:07 user nova-compute[74131]: INFO nova.compute.manager [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Attaching volume a643ef59-b981-424c-9cd8-e1226055399e to /dev/vdb
Oct 20 16:31:07 user nova-compute[74131]: DEBUG os_brick.utils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bbfbcb-76ce-4e39-b738-09e9c8d9caa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a32877b-d96a-43c1-9577-e8fa30a6e247]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:07 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4409c2-d4d7-4463-9f3b-f43df0dce967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3078fd75-d143-4b16-b9be-ce227b67a6e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:31:08 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3017f0-b1d6-4c08-bf8b-10e5b45ba29f]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG os_brick.utils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating existing volume attachment record: 4f5c0288-79a8-40f7-a8c6-019db6dacc52 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Successfully created port: ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "810cb8ab-756c-46df-a052-839812e83ec2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "810cb8ab-756c-46df-a052-839812e83ec2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "810cb8ab-756c-46df-a052-839812e83ec2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:08 user nova-compute[74131]: INFO nova.compute.manager [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Terminating instance
Oct 20 16:31:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-4c1ac206-2b66-4cd5-ad6f-6560919de5b5 req-02632cb0-1905-4436-99fd-511c776e1054 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received event network-vif-unplugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4c1ac206-2b66-4cd5-ad6f-6560919de5b5 req-02632cb0-1905-4436-99fd-511c776e1054 service nova] Acquiring lock "810cb8ab-756c-46df-a052-839812e83ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4c1ac206-2b66-4cd5-ad6f-6560919de5b5 req-02632cb0-1905-4436-99fd-511c776e1054 service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4c1ac206-2b66-4cd5-ad6f-6560919de5b5 req-02632cb0-1905-4436-99fd-511c776e1054 service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-4c1ac206-2b66-4cd5-ad6f-6560919de5b5 req-02632cb0-1905-4436-99fd-511c776e1054 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] No waiting events found dispatching network-vif-unplugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-4c1ac206-2b66-4cd5-ad6f-6560919de5b5 req-02632cb0-1905-4436-99fd-511c776e1054 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received event network-vif-unplugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Successfully updated port: ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing instance network info cache due to event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Instance destroyed successfully.
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'resources' on Instance uuid 810cb8ab-756c-46df-a052-839812e83ec2 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-699937794',display_name='tempest-TestVolumeBootPattern-server-699937794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-699937794',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-cdtz03c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:29:50Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=810cb8ab-756c-46df-a052-839812e83ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "address": "fa:16:3e:95:71:39", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap202e4ef3-d6", "ovs_interfaceid": "202e4ef3-d665-4e02-8c18-6c45c0fb21d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:71:39,bridge_name='br-int',has_traffic_filtering=True,id=202e4ef3-d665-4e02-8c18-6c45c0fb21d9,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap202e4ef3-d6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_vif [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:71:39,bridge_name='br-int',has_traffic_filtering=True,id=202e4ef3-d665-4e02-8c18-6c45c0fb21d9,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap202e4ef3-d6') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap202e4ef3-d6, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=633b722e-3db6-45a1-99bf-b20b769da123) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:09 user nova-compute[74131]: INFO os_vif [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:71:39,bridge_name='br-int',has_traffic_filtering=True,id=202e4ef3-d665-4e02-8c18-6c45c0fb21d9,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap202e4ef3-d6')
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UckFqiOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance network_info: |[{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG nova.network.neutron [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b9c43-467b-4306-a0fb-cd93f648782e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:31:09 user nova-compute[74131]: No targets found.
Oct 20 16:31:09 user nova-compute[74131]: iSNS:
Oct 20 16:31:09 user nova-compute[74131]: No targets found.
Oct 20 16:31:09 user nova-compute[74131]: STATIC:
Oct 20 16:31:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608
Oct 20 16:31:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:31:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0
Oct 20 16:31:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:31:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:09 user nova-compute[74131]: FIRMWARE:
Oct 20 16:31:09 user nova-compute[74131]: No targets found.
Oct 20 16:31:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:31:09 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:31:09 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f71b69-f321-4d5d-b97d-42f16c6aec43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6444237c-9170-458c-855b-330f634a20a3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:31:09 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:09 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:09 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 (non-flash)
Oct 20 16:31:09 user nova-compute[74131]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:09 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:09 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87ee710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[99589752-db1f-4a18-af85-5dc292e10042]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[62137ff1-97cd-4149-b979-db0fe8a0eeba]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f972457-1fde-4f86-ad18-b82b8cd88232]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:31:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[574cb9ce-e507-450c-a8e4-38d29dfa383f]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fdc78f-c2db-4df4-bdc9-c0ebb58de8b1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca80355-0574-4966-95e8-dded5a66ad6d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260]
Oct 20 16:31:10 user nova-compute[74131]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608, portal: 172.16.0.220,3260] successful.
Oct 20 16:31:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a11e6757-59c2-413f-a345-d5db64cc3608 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[adee83fe-762b-43c2-88ee-d675ef61a041]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== disconnect_volume: return (369ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:31:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Deleting instance files /opt/stack/data/nova/instances/810cb8ab-756c-46df-a052-839812e83ec2_del
Oct 20 16:31:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Deletion of /opt/stack/data/nova/instances/810cb8ab-756c-46df-a052-839812e83ec2_del complete
Oct 20 16:31:10 user nova-compute[74131]: INFO nova.compute.manager [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Took 1.48 seconds to destroy the instance on the hypervisor.
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG nova.network.neutron [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updated VIF entry in instance network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG nova.network.neutron [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b77911b5-e2c0-42e1-8e91-48e2de3574db req-184f445b-9ba8-419e-b3f6-c82c02c549c0 service nova] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-3382daf5-fccc-4e0e-9213-51d5024fb2c1 req-f725a752-0ac1-443c-a9f5-ce4ba230d14b service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received event network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3382daf5-fccc-4e0e-9213-51d5024fb2c1 req-f725a752-0ac1-443c-a9f5-ce4ba230d14b service nova] Acquiring lock "810cb8ab-756c-46df-a052-839812e83ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3382daf5-fccc-4e0e-9213-51d5024fb2c1 req-f725a752-0ac1-443c-a9f5-ce4ba230d14b service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3382daf5-fccc-4e0e-9213-51d5024fb2c1 req-f725a752-0ac1-443c-a9f5-ce4ba230d14b service nova] Lock "810cb8ab-756c-46df-a052-839812e83ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-3382daf5-fccc-4e0e-9213-51d5024fb2c1 req-f725a752-0ac1-443c-a9f5-ce4ba230d14b service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] No waiting events found dispatching network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:11 user nova-compute[74131]: WARNING nova.compute.manager [req-3382daf5-fccc-4e0e-9213-51d5024fb2c1 req-f725a752-0ac1-443c-a9f5-ce4ba230d14b service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received unexpected event network-vif-plugged-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 for instance with vm_state active and task_state deleting.
Oct 20 16:31:11 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:11 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Took 0.93 seconds to deallocate network for instance.
Oct 20 16:31:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-cf9679b1-085c-4cbb-9bd0-f65c0af45d72 req-39c1e689-d42e-4cf0-a27a-be91abfb18e5 service nova] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Received event network-vif-deleted-202e4ef3-d665-4e02-8c18-6c45c0fb21d9 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:12 user nova-compute[74131]: INFO nova.compute.manager [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Took 0.90 seconds to detach 1 volumes for instance.
Oct 20 16:31:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 810cb8ab-756c-46df-a052-839812e83ec2] Deleting volume: a11e6757-59c2-413f-a345-d5db64cc3608 {{(pid=74131) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 16:31:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:12 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:31:12 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:31:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:12 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Deleted allocations for instance 810cb8ab-756c-46df-a052-839812e83ec2
Oct 20 16:31:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5d8bc6c-2f47-4492-803a-d52409647e88 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "810cb8ab-756c-46df-a052-839812e83ec2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.227s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:31:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:31:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:31:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:31:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:23 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:31:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:31:25 user nova-compute[74131]: INFO nova.compute.claims [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Claim successful on node user
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:31:25 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:31:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:31:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG nova.policy [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a4098f7e8234722be739368cd364444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c666b56163d8480bb7977e63b2bb534a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:31:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Creating image(s)
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "/opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "/opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "/opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.036s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk 1073741824" returned: 0 in 0.061s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Successfully created port: 8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Cannot resize image /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Ensure instance console log exists: /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Successfully updated port: 8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-changed-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Refreshing instance network info cache due to event network-changed-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] Acquiring lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] Acquired lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Refreshing network info cache for port 8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7659MB free_disk=25.164817810058594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-49f0aab1-c2a0-4239-ac1b-bea171ac4b80 req-4b52393c-33cd-4b01-8b44-bad90f010a6f service nova] Releasing lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquired lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 52b4f002-76fb-45c7-8b60-25c56d40740c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 42233b10-3752-4adf-89de-7ebe52bd1e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updating instance_info_cache with network_info: [{"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Releasing lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Instance network_info: |[{"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Start _get_guest_xml network_info=[{"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:31:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-203074645',display_name='tempest-TestStampPattern-server-203074645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-203074645',id=27,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzrap9i4Orsu8IzJ1UVjCZ+WyzfeweRZL/LOfQEErLq7dnmtfZqasg1PuC2aF1xBY+d7pssB1ZDto0my2u854/qSoSCcSBXiI+sw6JGAguv5NwG+H5EAVR6yOkNKhXWPA==',key_name='tempest-TestStampPattern-1512427519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c666b56163d8480bb7977e63b2bb534a',ramdisk_id='',reservation_id='r-8hdyui03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-377185534',owner_user_name='tempest-TestStampPattern-377185534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:26Z,user_data=None,user_id='6a4098f7e8234722be739368cd364444',uuid=a16108af-bab9-4146-a928-4b2191f6f458,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converting VIF {"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b2:50,bridge_name='br-int',has_traffic_filtering=True,id=8f7d9300-b2cb-4eed-a1d4-48f9ecfce446,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f7d9300-b2') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'pci_devices' on Instance uuid a16108af-bab9-4146-a928-4b2191f6f458 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:31:28 user nova-compute[74131]:   <uuid>a16108af-bab9-4146-a928-4b2191f6f458</uuid>
Oct 20 16:31:28 user nova-compute[74131]:   <name>instance-0000001b</name>
Oct 20 16:31:28 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:31:28 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:31:28 user nova-compute[74131]:   <metadata>
Oct 20 16:31:28 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:31:28 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:31:28 user nova-compute[74131]:       <nova:name>tempest-TestStampPattern-server-203074645</nova:name>
Oct 20 16:31:28 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:31:28</nova:creationTime>
Oct 20 16:31:28 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:31:28 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:31:28 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:31:28 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:31:28 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:31:28 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:31:28 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:31:28 user nova-compute[74131]:       <nova:owner>
Oct 20 16:31:28 user nova-compute[74131]:         <nova:user uuid="6a4098f7e8234722be739368cd364444">tempest-TestStampPattern-377185534-project-member</nova:user>
Oct 20 16:31:28 user nova-compute[74131]:         <nova:project uuid="c666b56163d8480bb7977e63b2bb534a">tempest-TestStampPattern-377185534</nova:project>
Oct 20 16:31:28 user nova-compute[74131]:       </nova:owner>
Oct 20 16:31:28 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:31:28 user nova-compute[74131]:       <nova:ports>
Oct 20 16:31:28 user nova-compute[74131]:         <nova:port uuid="8f7d9300-b2cb-4eed-a1d4-48f9ecfce446">
Oct 20 16:31:28 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 16:31:28 user nova-compute[74131]:         </nova:port>
Oct 20 16:31:28 user nova-compute[74131]:       </nova:ports>
Oct 20 16:31:28 user nova-compute[74131]:     </nova:instance>
Oct 20 16:31:28 user nova-compute[74131]:   </metadata>
Oct 20 16:31:28 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:31:28 user nova-compute[74131]:     <system>
Oct 20 16:31:28 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:31:28 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:31:28 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:31:28 user nova-compute[74131]:       <entry name="serial">a16108af-bab9-4146-a928-4b2191f6f458</entry>
Oct 20 16:31:28 user nova-compute[74131]:       <entry name="uuid">a16108af-bab9-4146-a928-4b2191f6f458</entry>
Oct 20 16:31:28 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:31:28 user nova-compute[74131]:     </system>
Oct 20 16:31:28 user nova-compute[74131]:   </sysinfo>
Oct 20 16:31:28 user nova-compute[74131]:   <os>
Oct 20 16:31:28 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:31:28 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:31:28 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:31:28 user nova-compute[74131]:   </os>
Oct 20 16:31:28 user nova-compute[74131]:   <features>
Oct 20 16:31:28 user nova-compute[74131]:     <acpi/>
Oct 20 16:31:28 user nova-compute[74131]:     <apic/>
Oct 20 16:31:28 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:31:28 user nova-compute[74131]:   </features>
Oct 20 16:31:28 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:31:28 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:31:28 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:31:28 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:31:28 user nova-compute[74131]:   </clock>
Oct 20 16:31:28 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:31:28 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:31:28 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:31:28 user nova-compute[74131]:   </cpu>
Oct 20 16:31:28 user nova-compute[74131]:   <devices>
Oct 20 16:31:28 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:31:28 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:31:28 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk"/>
Oct 20 16:31:28 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:31:28 user nova-compute[74131]:     </disk>
Oct 20 16:31:28 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:31:28 user nova-compute[74131]:       <mac address="fa:16:3e:d2:b2:50"/>
Oct 20 16:31:28 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:28 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:31:28 user nova-compute[74131]:       <target dev="tap8f7d9300-b2"/>
Oct 20 16:31:28 user nova-compute[74131]:     </interface>
Oct 20 16:31:28 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:31:28 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/console.log" append="off"/>
Oct 20 16:31:28 user nova-compute[74131]:     </serial>
Oct 20 16:31:28 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:31:28 user nova-compute[74131]:     <video>
Oct 20 16:31:28 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:28 user nova-compute[74131]:     </video>
Oct 20 16:31:28 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:31:28 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:31:28 user nova-compute[74131]:     </rng>
Oct 20 16:31:28 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:31:28 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:31:28 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:31:28 user nova-compute[74131]:     </memballoon>
Oct 20 16:31:28 user nova-compute[74131]:   </devices>
Oct 20 16:31:28 user nova-compute[74131]: </domain>
Oct 20 16:31:28 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-203074645',display_name='tempest-TestStampPattern-server-203074645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-203074645',id=27,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzrap9i4Orsu8IzJ1UVjCZ+WyzfeweRZL/LOfQEErLq7dnmtfZqasg1PuC2aF1xBY+d7pssB1ZDto0my2u854/qSoSCcSBXiI+sw6JGAguv5NwG+H5EAVR6yOkNKhXWPA==',key_name='tempest-TestStampPattern-1512427519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c666b56163d8480bb7977e63b2bb534a',ramdisk_id='',reservation_id='r-8hdyui03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-377185534',owner_user_name='tempest-TestStampPattern-377185534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:26Z,user_data=None,user_id='6a4098f7e8234722be739368cd364444',uuid=a16108af-bab9-4146-a928-4b2191f6f458,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converting VIF {"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b2:50,bridge_name='br-int',has_traffic_filtering=True,id=8f7d9300-b2cb-4eed-a1d4-48f9ecfce446,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f7d9300-b2') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG os_vif [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b2:50,bridge_name='br-int',has_traffic_filtering=True,id=8f7d9300-b2cb-4eed-a1d4-48f9ecfce446,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f7d9300-b2') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '979197e0-b903-578d-a661-f524238d56bd', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f7d9300-b2, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f7d9300-b2, col_values=(('qos', UUID('08c7fa7f-6820-40a2-9539-666eed0a3af5')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f7d9300-b2, col_values=(('external_ids', {'iface-id': '8f7d9300-b2cb-4eed-a1d4-48f9ecfce446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:b2:50', 'vm-uuid': 'a16108af-bab9-4146-a928-4b2191f6f458'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:28 user nova-compute[74131]: INFO os_vif [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b2:50,bridge_name='br-int',has_traffic_filtering=True,id=8f7d9300-b2cb-4eed-a1d4-48f9ecfce446,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f7d9300-b2')
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No VIF found with MAC fa:16:3e:d2:b2:50, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:31:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-aef42841-51dd-4c8f-8e6d-789d2d5e37b6 req-40387827-025e-4109-938f-9c7a7ac7822e service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aef42841-51dd-4c8f-8e6d-789d2d5e37b6 req-40387827-025e-4109-938f-9c7a7ac7822e service nova] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aef42841-51dd-4c8f-8e6d-789d2d5e37b6 req-40387827-025e-4109-938f-9c7a7ac7822e service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aef42841-51dd-4c8f-8e6d-789d2d5e37b6 req-40387827-025e-4109-938f-9c7a7ac7822e service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-aef42841-51dd-4c8f-8e6d-789d2d5e37b6 req-40387827-025e-4109-938f-9c7a7ac7822e service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] No waiting events found dispatching network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:30 user nova-compute[74131]: WARNING nova.compute.manager [req-aef42841-51dd-4c8f-8e6d-789d2d5e37b6 req-40387827-025e-4109-938f-9c7a7ac7822e service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received unexpected event network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 for instance with vm_state building and task_state spawning.
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-8f5f3956-2daf-47aa-ae93-e6564b0cfc10 req-56fec58d-8c19-4a95-b955-768e43a5f0d7 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8f5f3956-2daf-47aa-ae93-e6564b0cfc10 req-56fec58d-8c19-4a95-b955-768e43a5f0d7 service nova] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8f5f3956-2daf-47aa-ae93-e6564b0cfc10 req-56fec58d-8c19-4a95-b955-768e43a5f0d7 service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8f5f3956-2daf-47aa-ae93-e6564b0cfc10 req-56fec58d-8c19-4a95-b955-768e43a5f0d7 service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-8f5f3956-2daf-47aa-ae93-e6564b0cfc10 req-56fec58d-8c19-4a95-b955-768e43a5f0d7 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] No waiting events found dispatching network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:32 user nova-compute[74131]: WARNING nova.compute.manager [req-8f5f3956-2daf-47aa-ae93-e6564b0cfc10 req-56fec58d-8c19-4a95-b955-768e43a5f0d7 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received unexpected event network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 for instance with vm_state building and task_state spawning.
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:31:32 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Instance spawned successfully.
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:32 user nova-compute[74131]: INFO nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Took 6.37 seconds to spawn the instance on the hypervisor.
Oct 20 16:31:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:31:32 user nova-compute[74131]: INFO nova.compute.manager [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Took 7.54 seconds to build instance.
Oct 20 16:31:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e101a220-d140-4e71-9a53-d30a4edc50fa tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.681s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:31:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:33 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:31:33 user nova-compute[74131]: INFO nova.compute.claims [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Claim successful on node user
Oct 20 16:31:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:31:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.policy [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79db1d105a6e406a965eb94987fdfaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac73a0c54fb4583aec623c4c7528428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:31:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Creating image(s)
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "/opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "/opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.255s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk 1073741824" returned: 0 in 0.051s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Successfully created port: dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Cannot resize image /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Ensure instance console log exists: /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Successfully updated port: dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquired lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-changed-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Refreshing instance network info cache due to event network-changed-dffa8252-791e-4011-aff0-2b2d2ca1c91b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] Acquiring lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Updating instance_info_cache with network_info: [{"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Releasing lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Instance network_info: |[{"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] Acquired lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Refreshing network info cache for port dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Start _get_guest_xml network_info=[{"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:31:36 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:36 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-739054007',display_name='tempest-AttachVolumeNegativeTest-server-739054007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-739054007',id=28,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxCXaSVNF+LXbTgctM8+a/IbWVKQcu1nXRDWNjzR5FAOvJQs80V8KeuLdeuo790tBdydFznMP2nxlGhNSWUEKwm/m8breoAggbplFwUuiGht3JvAz8p60UQd9iPHowAcA==',key_name='tempest-keypair-1388881125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-50yu80db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=81225581-aa2b-44dc-a7f0-70c94af0cff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:73:e2,bridge_name='br-int',has_traffic_filtering=True,id=dffa8252-791e-4011-aff0-2b2d2ca1c91b,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffa8252-79') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'pci_devices' on Instance uuid 81225581-aa2b-44dc-a7f0-70c94af0cff3 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:31:36 user nova-compute[74131]:   <uuid>81225581-aa2b-44dc-a7f0-70c94af0cff3</uuid>
Oct 20 16:31:36 user nova-compute[74131]:   <name>instance-0000001c</name>
Oct 20 16:31:36 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:31:36 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:31:36 user nova-compute[74131]:   <metadata>
Oct 20 16:31:36 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:31:36 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:31:36 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeNegativeTest-server-739054007</nova:name>
Oct 20 16:31:36 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:31:36</nova:creationTime>
Oct 20 16:31:36 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:31:36 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:31:36 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:31:36 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:31:36 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:31:36 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:31:36 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:31:36 user nova-compute[74131]:       <nova:owner>
Oct 20 16:31:36 user nova-compute[74131]:         <nova:user uuid="79db1d105a6e406a965eb94987fdfaf3">tempest-AttachVolumeNegativeTest-395634699-project-member</nova:user>
Oct 20 16:31:36 user nova-compute[74131]:         <nova:project uuid="3ac73a0c54fb4583aec623c4c7528428">tempest-AttachVolumeNegativeTest-395634699</nova:project>
Oct 20 16:31:36 user nova-compute[74131]:       </nova:owner>
Oct 20 16:31:36 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:31:36 user nova-compute[74131]:       <nova:ports>
Oct 20 16:31:36 user nova-compute[74131]:         <nova:port uuid="dffa8252-791e-4011-aff0-2b2d2ca1c91b">
Oct 20 16:31:36 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 16:31:36 user nova-compute[74131]:         </nova:port>
Oct 20 16:31:36 user nova-compute[74131]:       </nova:ports>
Oct 20 16:31:36 user nova-compute[74131]:     </nova:instance>
Oct 20 16:31:36 user nova-compute[74131]:   </metadata>
Oct 20 16:31:36 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:31:36 user nova-compute[74131]:     <system>
Oct 20 16:31:36 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:31:36 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:31:36 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:31:36 user nova-compute[74131]:       <entry name="serial">81225581-aa2b-44dc-a7f0-70c94af0cff3</entry>
Oct 20 16:31:36 user nova-compute[74131]:       <entry name="uuid">81225581-aa2b-44dc-a7f0-70c94af0cff3</entry>
Oct 20 16:31:36 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:31:36 user nova-compute[74131]:     </system>
Oct 20 16:31:36 user nova-compute[74131]:   </sysinfo>
Oct 20 16:31:36 user nova-compute[74131]:   <os>
Oct 20 16:31:36 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:31:36 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:31:36 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:31:36 user nova-compute[74131]:   </os>
Oct 20 16:31:36 user nova-compute[74131]:   <features>
Oct 20 16:31:36 user nova-compute[74131]:     <acpi/>
Oct 20 16:31:36 user nova-compute[74131]:     <apic/>
Oct 20 16:31:36 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:31:36 user nova-compute[74131]:   </features>
Oct 20 16:31:36 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:31:36 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:31:36 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:31:36 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:31:36 user nova-compute[74131]:   </clock>
Oct 20 16:31:36 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:31:36 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:31:36 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:31:36 user nova-compute[74131]:   </cpu>
Oct 20 16:31:36 user nova-compute[74131]:   <devices>
Oct 20 16:31:36 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:31:36 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:31:36 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk"/>
Oct 20 16:31:36 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:31:36 user nova-compute[74131]:     </disk>
Oct 20 16:31:36 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:31:36 user nova-compute[74131]:       <mac address="fa:16:3e:cd:73:e2"/>
Oct 20 16:31:36 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:36 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:31:36 user nova-compute[74131]:       <target dev="tapdffa8252-79"/>
Oct 20 16:31:36 user nova-compute[74131]:     </interface>
Oct 20 16:31:36 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:31:36 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/console.log" append="off"/>
Oct 20 16:31:36 user nova-compute[74131]:     </serial>
Oct 20 16:31:36 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:31:36 user nova-compute[74131]:     <video>
Oct 20 16:31:36 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:36 user nova-compute[74131]:     </video>
Oct 20 16:31:36 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:31:36 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:31:36 user nova-compute[74131]:     </rng>
Oct 20 16:31:36 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:31:36 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:31:36 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:31:36 user nova-compute[74131]:     </memballoon>
Oct 20 16:31:36 user nova-compute[74131]:   </devices>
Oct 20 16:31:36 user nova-compute[74131]: </domain>
Oct 20 16:31:36 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-739054007',display_name='tempest-AttachVolumeNegativeTest-server-739054007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-739054007',id=28,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxCXaSVNF+LXbTgctM8+a/IbWVKQcu1nXRDWNjzR5FAOvJQs80V8KeuLdeuo790tBdydFznMP2nxlGhNSWUEKwm/m8breoAggbplFwUuiGht3JvAz8p60UQd9iPHowAcA==',key_name='tempest-keypair-1388881125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-50yu80db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=81225581-aa2b-44dc-a7f0-70c94af0cff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:73:e2,bridge_name='br-int',has_traffic_filtering=True,id=dffa8252-791e-4011-aff0-2b2d2ca1c91b,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffa8252-79') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG os_vif [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:73:e2,bridge_name='br-int',has_traffic_filtering=True,id=dffa8252-791e-4011-aff0-2b2d2ca1c91b,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffa8252-79') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca385a3c-5abf-549c-9f83-d853b8d3eb3f', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdffa8252-79, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdffa8252-79, col_values=(('qos', UUID('a4c0e149-7d6b-4d8a-9f70-80952b6f1aae')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdffa8252-79, col_values=(('external_ids', {'iface-id': 'dffa8252-791e-4011-aff0-2b2d2ca1c91b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:73:e2', 'vm-uuid': '81225581-aa2b-44dc-a7f0-70c94af0cff3'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:36 user nova-compute[74131]: INFO os_vif [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:73:e2,bridge_name='br-int',has_traffic_filtering=True,id=dffa8252-791e-4011-aff0-2b2d2ca1c91b,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffa8252-79')
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No VIF found with MAC fa:16:3e:cd:73:e2, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Updated VIF entry in instance network info cache for port dffa8252-791e-4011-aff0-2b2d2ca1c91b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Updating instance_info_cache with network_info: [{"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-90f667ee-45fc-4df5-a53d-7f4bc3400947 req-70d5034b-55cc-4ed4-be6f-f123b9918eb6 service nova] Releasing lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-38e55e68-782f-4c37-9167-68494bbb83e0 req-b5cdd66a-f950-41f1-8cc4-d39089fdde01 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-38e55e68-782f-4c37-9167-68494bbb83e0 req-b5cdd66a-f950-41f1-8cc4-d39089fdde01 service nova] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-38e55e68-782f-4c37-9167-68494bbb83e0 req-b5cdd66a-f950-41f1-8cc4-d39089fdde01 service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-38e55e68-782f-4c37-9167-68494bbb83e0 req-b5cdd66a-f950-41f1-8cc4-d39089fdde01 service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-38e55e68-782f-4c37-9167-68494bbb83e0 req-b5cdd66a-f950-41f1-8cc4-d39089fdde01 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] No waiting events found dispatching network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:37 user nova-compute[74131]: WARNING nova.compute.manager [req-38e55e68-782f-4c37-9167-68494bbb83e0 req-b5cdd66a-f950-41f1-8cc4-d39089fdde01 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received unexpected event network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b for instance with vm_state building and task_state spawning.
Oct 20 16:31:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:31:39 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Instance spawned successfully.
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-ddd5edde-d81d-497b-ae26-d069afd2bc7e req-59a11d3c-5994-4357-a6ac-c68e06ec9cd3 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ddd5edde-d81d-497b-ae26-d069afd2bc7e req-59a11d3c-5994-4357-a6ac-c68e06ec9cd3 service nova] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ddd5edde-d81d-497b-ae26-d069afd2bc7e req-59a11d3c-5994-4357-a6ac-c68e06ec9cd3 service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ddd5edde-d81d-497b-ae26-d069afd2bc7e req-59a11d3c-5994-4357-a6ac-c68e06ec9cd3 service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-ddd5edde-d81d-497b-ae26-d069afd2bc7e req-59a11d3c-5994-4357-a6ac-c68e06ec9cd3 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] No waiting events found dispatching network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:40 user nova-compute[74131]: WARNING nova.compute.manager [req-ddd5edde-d81d-497b-ae26-d069afd2bc7e req-59a11d3c-5994-4357-a6ac-c68e06ec9cd3 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received unexpected event network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b for instance with vm_state building and task_state spawning.
Oct 20 16:31:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:40 user nova-compute[74131]: INFO nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Took 5.77 seconds to spawn the instance on the hypervisor.
Oct 20 16:31:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:31:40 user nova-compute[74131]: INFO nova.compute.manager [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Took 6.75 seconds to build instance.
Oct 20 16:31:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6a065788-db89-4101-976e-44af0ba75e85 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.882s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:42 user nova-compute[74131]: INFO nova.compute.manager [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Rescuing
Oct 20 16:31:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:31:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:31:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG nova.network.neutron [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating instance_info_cache with network_info: [{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-c33b4334-3a27-435e-9f4b-648e41120306 req-cb553aa9-f0f8-440f-83fc-33fd8400e0e2 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c33b4334-3a27-435e-9f4b-648e41120306 req-cb553aa9-f0f8-440f-83fc-33fd8400e0e2 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c33b4334-3a27-435e-9f4b-648e41120306 req-cb553aa9-f0f8-440f-83fc-33fd8400e0e2 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c33b4334-3a27-435e-9f4b-648e41120306 req-cb553aa9-f0f8-440f-83fc-33fd8400e0e2 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-c33b4334-3a27-435e-9f4b-648e41120306 req-cb553aa9-f0f8-440f-83fc-33fd8400e0e2 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:43 user nova-compute[74131]: WARNING nova.compute.manager [req-c33b4334-3a27-435e-9f4b-648e41120306 req-cb553aa9-f0f8-440f-83fc-33fd8400e0e2 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state active and task_state rescuing.
Oct 20 16:31:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance destroyed successfully.
Oct 20 16:31:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Attempting a stable device rescue
Oct 20 16:31:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74131) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 16:31:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:31:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Creating image(s)
Oct 20 16:31:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:44 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "57dd5aa6c644d539b13d898245d60d79cfb5d502" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "57dd5aa6c644d539b13d898245d60d79cfb5d502" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:45 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.part --force-share --output=json" returned: 0 in 0.206s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG nova.virt.images [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] 815ec192-ad98-44a4-914b-d9d9c21de56a was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.part /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260" returned: 21 in 0.049s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6852cceb-43a8-41b0-9edb-05b9ff26e6c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:31:45 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.044s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf02fa3e-53f2-488c-bd81-051665978b51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e] added
Oct 20 16:31:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-e7348f5d-4bff-41c3-8e69-9f4c4f64e2f7 req-b0e7799d-e43a-442c-bb32-b1cf91f34af4 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e7348f5d-4bff-41c3-8e69-9f4c4f64e2f7 req-b0e7799d-e43a-442c-bb32-b1cf91f34af4 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e7348f5d-4bff-41c3-8e69-9f4c4f64e2f7 req-b0e7799d-e43a-442c-bb32-b1cf91f34af4 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e7348f5d-4bff-41c3-8e69-9f4c4f64e2f7 req-b0e7799d-e43a-442c-bb32-b1cf91f34af4 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-e7348f5d-4bff-41c3-8e69-9f4c4f64e2f7 req-b0e7799d-e43a-442c-bb32-b1cf91f34af4 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:45 user nova-compute[74131]: WARNING nova.compute.manager [req-e7348f5d-4bff-41c3-8e69-9f4c4f64e2f7 req-b0e7799d-e43a-442c-bb32-b1cf91f34af4 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state active and task_state rescuing.
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ece300-558a-4056-bcc7-fc3ed8c0b737]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.202s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a38e38-6d0c-495d-a222-3ab0f175ae92]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVtcMveW {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVtcMveW" returned: 0 in 0.237s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5590a1e4-5fdb-46de-a755-9befba04e140]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uVtcMveW'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:31:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Creating image(s)
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Ensure instance console log exists: /opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Start _get_guest_xml network_info=[{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c65accda-7de6-4609-a350-3c06ea4c6647', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c80c4b9-4ab7-45e1-aca6-2bef81ffb635', 'attached_at': '', 'detached_at': '', 'volume_id': '67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'serial': '67480b9d-ee42-44ae-bb15-41c5ecb1dc01'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bd3457-e977-420e-bb66-b6d9c58aa9c0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4de481-eeb9-45dc-ad27-036e844ad9b6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:46 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:46 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:46 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:46 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:46 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.part /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.converted" returned: 0 in 0.841s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "57dd5aa6c644d539b13d898245d60d79cfb5d502" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.420s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "57dd5aa6c644d539b13d898245d60d79cfb5d502" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "57dd5aa6c644d539b13d898245d60d79cfb5d502" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502 --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502,backing_fmt=raw /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502,backing_fmt=raw /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue" returned: 0 in 0.049s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "57dd5aa6c644d539b13d898245d60d79cfb5d502" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'migration_context' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Start _get_guest_xml network_info=[{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "vif_mac": "fa:16:3e:c7:90:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '815ec192-ad98-44a4-914b-d9d9c21de56a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '858ede3d-f535-483a-8467-9cd0fc71f178', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUGtmSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0', 'attached_at': '', 'detached_at': '', 'volume_id': '48da990f-1ed3-4d55-b607-f5bb688f72fe', 'serial': '48da990f-1ed3-4d55-b607-f5bb688f72fe'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'resources' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'numa_topology' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:31:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.objects.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUGtmSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:46 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:31:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --login" returned: 0 in 1.068s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38739c2-ea99-46ca-9622-c3b9f2753e21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]
Oct 20 16:31:47 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.
Oct 20 16:31:47 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f7f1e3-9856-450b-b75e-4f9e760de356]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[448f8158-3a4e-4ea8-8c28-e64b27f8d5ab]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:47 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:47 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:47 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:47 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:47 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:47 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:47 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:47 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.835s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c6f41-1381-4eed-93d9-9f26fb2b687b]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:31:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.880s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== connect_volume: return (2882ms) {'type': 'block', 'scsi_wwn': '26266346362313565', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266346362313565', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:48 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG nova.objects.instance [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'flavor' on Instance uuid 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[382df983-e8ae-4340-b5fc-642db34535bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:31:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:31:48 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:31:48 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:31:48 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:31:48 user nova-compute[74131]:   <serial>a643ef59-b981-424c-9cd8-e1226055399e</serial>
Oct 20 16:31:48 user nova-compute[74131]: </disk>
Oct 20 16:31:48 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d7a2ce-ceb2-45aa-bdd5-0f4b325645b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01] added
Oct 20 16:31:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ec26f3-3f25-4940-983a-69c6a88d20c4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.059s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc2b15f-7cce-48e8-8b16-2b06c07a03c3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJgeZKDA {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJgeZKDA" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19039f5-3f0d-4d91-af50-1496ae1089d9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mJgeZKDA'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bde7d8-d9f7-4bf6-8486-a0e45ee752a7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5709d6e1-c0e5-4730-b8c8-0c382b0c125d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[67229c05-c9d8-4df0-b031-baf8d97b80df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]
Oct 20 16:31:48 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.
Oct 20 16:31:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd1c5e-fefb-49ed-aa29-09e9e9184b01]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b7cc91-4c6b-43cb-be01-a29f46ce6c71]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:48 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1340c28-93ee-41a7-b8cc-eaf94e65eb89]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:31:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No VIF found with MAC fa:16:3e:78:ef:ca, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-60db8b10-0a05-4679-bfdf-8a594effb4f3 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.173s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] <== connect_volume: return (3400ms) {'type': 'block', 'scsi_wwn': '23138326364633030', 'path': '/dev/sdf'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138326364633030', 'path': '/dev/sdf'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.754s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:49 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:49 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115633c-41e7-4717-b423-cee89ad1e3cb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cUGtmSYA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 16:31:49 user nova-compute[74131]: node.name = iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:31:49 user nova-compute[74131]: node.tpgt = -1
Oct 20 16:31:49 user nova-compute[74131]: node.startup = automatic
Oct 20 16:31:49 user nova-compute[74131]: node.leading_login = No
Oct 20 16:31:49 user nova-compute[74131]: iface.iscsi_ifacename = default
Oct 20 16:31:49 user nova-compute[74131]: iface.net_ifacename = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.ipaddress = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.prefix_len = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.hwaddress = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.transport_name = tcp
Oct 20 16:31:49 user nova-compute[74131]: iface.initiatorname = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.state = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.vlan_id = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.vlan_priority = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.vlan_state = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.iface_num = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.mtu = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.port = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.bootproto = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.subnet_mask = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.gateway = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_alt_client_id = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_dns = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_learn_iqn = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_vendor_id_state = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_vendor_id = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.dhcp_slp_da = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.fragmentation = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.gratuitous_arp = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.incoming_forwarding = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.tos_state = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.tos = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.ttl = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.delayed_ack = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.tcp_nagle = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.tcp_wsf_state = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.tcp_wsf = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.tcp_timer_scale = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.tcp_timestamp = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.redirect = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.def_task_mgmt_timeout = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.header_digest = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.data_digest = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.immediate_data = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.initial_r2t = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.data_seq_inorder = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.data_pdu_inorder = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.erl = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.max_receive_data_len = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.first_burst_len = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.max_outstanding_r2t = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.max_burst_len = 0
Oct 20 16:31:49 user nova-compute[74131]: iface.chap_auth = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.bidi_chap = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.strict_login_compliance = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.discovery_auth = <empty>
Oct 20 16:31:49 user nova-compute[74131]: iface.discovery_logout = <empty>
Oct 20 16:31:49 user nova-compute[74131]: node.discovery_address = <empty>
Oct 20 16:31:49 user nova-compute[74131]: node.discovery_port = 0
Oct 20 16:31:49 user nova-compute[74131]: node.discovery_type = static
Oct 20 16:31:49 user nova-compute[74131]: node.session.initial_cmdsn = 0
Oct 20 16:31:49 user nova-compute[74131]: node.session.initial_login_retry_max = 8
Oct 20 16:31:49 user nova-compute[74131]: node.session.xmit_thread_priority = -20
Oct 20 16:31:49 user nova-compute[74131]: node.session.cmds_max = 128
Oct 20 16:31:49 user nova-compute[74131]: node.session.queue_depth = 32
Oct 20 16:31:49 user nova-compute[74131]: node.session.nr_sessions = 1
Oct 20 16:31:49 user nova-compute[74131]: node.session.auth.authmethod = CHAP
Oct 20 16:31:49 user nova-compute[74131]: node.session.auth.username = cUGtmSYA
Oct 20 16:31:49 user nova-compute[74131]: node.session.auth.password = ***
Oct 20 16:31:49 user nova-compute[74131]: node.session.auth.username_in = <empty>
Oct 20 16:31:49 user nova-compute[74131]: node.session.auth.password_in = <empty>
Oct 20 16:31:49 user nova-compute[74131]: node.session.auth.chap_algs = MD5
Oct 20 16:31:49 user nova-compute[74131]: node.session.timeo.replacement_timeout = 120
Oct 20 16:31:49 user nova-compute[74131]: node.session.err_timeo.abort_timeout = 15
Oct 20 16:31:49 user nova-compute[74131]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 16:31:49 user nova-compute[74131]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 16:31:49 user nova-compute[74131]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.FastAbort = Yes
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.InitialR2T = No
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.ImmediateData = Yes
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.MaxConnections = 1
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 16:31:49 user nova-compute[74131]: node.session.iscsi.ERL = 0
Oct 20 16:31:49 user nova-compute[74131]: node.session.scan = manual
Oct 20 16:31:49 user nova-compute[74131]: node.session.reopen_max = 0
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].address = 172.16.0.220
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].port = 3260
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].startup = manual
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].tcp.window_size = 524288
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].tcp.type_of_service = 0
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].timeo.logout_timeout = 15
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].timeo.login_timeout = 15
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].timeo.auth_timeout = 45
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].iscsi.DataDigest = None
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].iscsi.IFMarker = No
Oct 20 16:31:49 user nova-compute[74131]: node.conn[0].iscsi.OFMarker = No
Oct 20 16:31:49 user nova-compute[74131]: # END RECORD
Oct 20 16:31:49 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1869711731',display_name='tempest-TestShelveInstance-server-1869711731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1869711731',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUJpKZ7EF3pMBcrZ8jN++RFwR8/CxEsDEstxbf+PP7z88HzQyANnHT228yzGCjshrKUPfLDZYwDuLx2aj5JTr07Q3kCISI9l9+7xCssaO1K13yoCfNczcpyUYs2bDCieg==',key_name='tempest-TestShelveInstance-1849926161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ce29bcf6e2431a92d345a3e739f81e',ramdisk_id='',reservation_id='r-t8xnfbd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1948790584',owner_user_name='tempest-TestShelveInstance-1948790584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:07Z,user_data=None,user_id='059cd89b482d4205a8d7f5a32037afd9',uuid=2c80c4b9-4ab7-45e1-aca6-2bef81ffb635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converting VIF {"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:31:49 user nova-compute[74131]:   <uuid>2c80c4b9-4ab7-45e1-aca6-2bef81ffb635</uuid>
Oct 20 16:31:49 user nova-compute[74131]:   <name>instance-0000001a</name>
Oct 20 16:31:49 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:31:49 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:31:49 user nova-compute[74131]:   <metadata>
Oct 20 16:31:49 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:31:49 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:name>tempest-TestShelveInstance-server-1869711731</nova:name>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:31:46</nova:creationTime>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:31:49 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:31:49 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:owner>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:user uuid="059cd89b482d4205a8d7f5a32037afd9">tempest-TestShelveInstance-1948790584-project-member</nova:user>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:project uuid="92ce29bcf6e2431a92d345a3e739f81e">tempest-TestShelveInstance-1948790584</nova:project>
Oct 20 16:31:49 user nova-compute[74131]:       </nova:owner>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:ports>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:port uuid="ddc3a20a-cba1-478b-8092-212e8242efdd">
Oct 20 16:31:49 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 16:31:49 user nova-compute[74131]:         </nova:port>
Oct 20 16:31:49 user nova-compute[74131]:       </nova:ports>
Oct 20 16:31:49 user nova-compute[74131]:     </nova:instance>
Oct 20 16:31:49 user nova-compute[74131]:   </metadata>
Oct 20 16:31:49 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:31:49 user nova-compute[74131]:     <system>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="serial">2c80c4b9-4ab7-45e1-aca6-2bef81ffb635</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="uuid">2c80c4b9-4ab7-45e1-aca6-2bef81ffb635</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:31:49 user nova-compute[74131]:     </system>
Oct 20 16:31:49 user nova-compute[74131]:   </sysinfo>
Oct 20 16:31:49 user nova-compute[74131]:   <os>
Oct 20 16:31:49 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:31:49 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:31:49 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:31:49 user nova-compute[74131]:   </os>
Oct 20 16:31:49 user nova-compute[74131]:   <features>
Oct 20 16:31:49 user nova-compute[74131]:     <acpi/>
Oct 20 16:31:49 user nova-compute[74131]:     <apic/>
Oct 20 16:31:49 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:31:49 user nova-compute[74131]:   </features>
Oct 20 16:31:49 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:31:49 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:31:49 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:31:49 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:31:49 user nova-compute[74131]:   </clock>
Oct 20 16:31:49 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:31:49 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:31:49 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:31:49 user nova-compute[74131]:   </cpu>
Oct 20 16:31:49 user nova-compute[74131]:   <devices>
Oct 20 16:31:49 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:31:49 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:31:49 user nova-compute[74131]:       <source dev="/dev/sdf"/>
Oct 20 16:31:49 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:31:49 user nova-compute[74131]:       <serial>67480b9d-ee42-44ae-bb15-41c5ecb1dc01</serial>
Oct 20 16:31:49 user nova-compute[74131]:     </disk>
Oct 20 16:31:49 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:31:49 user nova-compute[74131]:       <mac address="fa:16:3e:05:02:41"/>
Oct 20 16:31:49 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:49 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:31:49 user nova-compute[74131]:       <target dev="tapddc3a20a-cb"/>
Oct 20 16:31:49 user nova-compute[74131]:     </interface>
Oct 20 16:31:49 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:31:49 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635/console.log" append="off"/>
Oct 20 16:31:49 user nova-compute[74131]:     </serial>
Oct 20 16:31:49 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:31:49 user nova-compute[74131]:     <video>
Oct 20 16:31:49 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:49 user nova-compute[74131]:     </video>
Oct 20 16:31:49 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:31:49 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:31:49 user nova-compute[74131]:     </rng>
Oct 20 16:31:49 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:31:49 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:31:49 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:31:49 user nova-compute[74131]:     </memballoon>
Oct 20 16:31:49 user nova-compute[74131]:   </devices>
Oct 20 16:31:49 user nova-compute[74131]: </domain>
Oct 20 16:31:49 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1869711731',display_name='tempest-TestShelveInstance-server-1869711731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1869711731',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUJpKZ7EF3pMBcrZ8jN++RFwR8/CxEsDEstxbf+PP7z88HzQyANnHT228yzGCjshrKUPfLDZYwDuLx2aj5JTr07Q3kCISI9l9+7xCssaO1K13yoCfNczcpyUYs2bDCieg==',key_name='tempest-TestShelveInstance-1849926161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ce29bcf6e2431a92d345a3e739f81e',ramdisk_id='',reservation_id='r-t8xnfbd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1948790584',owner_user_name='tempest-TestShelveInstance-1948790584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:07Z,user_data=None,user_id='059cd89b482d4205a8d7f5a32037afd9',uuid=2c80c4b9-4ab7-45e1-aca6-2bef81ffb635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converting VIF {"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_vif [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3975045-0d8d-4f15-a524-bd11fac50a5a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8baf684f-70c9-5316-94d8-9cee2adc44df', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddc3a20a-cb, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddc3a20a-cb, col_values=(('qos', UUID('5be7dc1e-2555-4ab3-92e3-70a0c53f888c')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddc3a20a-cb, col_values=(('external_ids', {'iface-id': 'ddc3a20a-cba1-478b-8092-212e8242efdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:02:41', 'vm-uuid': '2c80c4b9-4ab7-45e1-aca6-2bef81ffb635'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea546bc7-f21b-4c71-96f9-5acfd6f31c07]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUGtmSYA {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:49 user nova-compute[74131]: INFO os_vif [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb')
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUGtmSYA" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b25e12-655e-4d1c-90fc-ba7c536339d5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUGtmSYA'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f51a2d-2916-4fca-8021-ad08ccbb1563]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] No VIF found with MAC fa:16:3e:05:02:41, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[48188a49-2547-478e-9f8a-15c7f0dfcea9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:49 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:49 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:49 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.190s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[478cedd8-2bd7-4dc8-8789-6848df16599b]: (4, ('0 0 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUGtmSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.218s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== connect_volume: return (2973ms) {'type': 'block', 'scsi_wwn': '26565353765383439', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565353765383439', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-92896468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-92896468',id=24,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:30:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-4pjv3am7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:30:27Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "vif_mac": "fa:16:3e:c7:90:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "vif_mac": "fa:16:3e:c7:90:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.objects.base [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:31:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:31:49 user nova-compute[74131]:   <uuid>3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0</uuid>
Oct 20 16:31:49 user nova-compute[74131]:   <name>instance-00000018</name>
Oct 20 16:31:49 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:31:49 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:31:49 user nova-compute[74131]:   <metadata>
Oct 20 16:31:49 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:31:49 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-92896468</nova:name>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:31:46</nova:creationTime>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:31:49 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:31:49 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:owner>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:user uuid="a82534b86e314f00896042e2e684a623">tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member</nova:user>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:project uuid="097a2eccca244cbfa897e6a573a3113d">tempest-ServerBootFromVolumeStableRescueTest-131352591</nova:project>
Oct 20 16:31:49 user nova-compute[74131]:       </nova:owner>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:31:49 user nova-compute[74131]:       <nova:ports>
Oct 20 16:31:49 user nova-compute[74131]:         <nova:port uuid="464ba822-ba37-482b-9a97-7bea0352d5d3">
Oct 20 16:31:49 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:31:49 user nova-compute[74131]:         </nova:port>
Oct 20 16:31:49 user nova-compute[74131]:       </nova:ports>
Oct 20 16:31:49 user nova-compute[74131]:     </nova:instance>
Oct 20 16:31:49 user nova-compute[74131]:   </metadata>
Oct 20 16:31:49 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:31:49 user nova-compute[74131]:     <system>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="serial">3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="uuid">3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0</entry>
Oct 20 16:31:49 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:31:49 user nova-compute[74131]:     </system>
Oct 20 16:31:49 user nova-compute[74131]:   </sysinfo>
Oct 20 16:31:49 user nova-compute[74131]:   <os>
Oct 20 16:31:49 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:31:49 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:31:49 user nova-compute[74131]:   </os>
Oct 20 16:31:49 user nova-compute[74131]:   <features>
Oct 20 16:31:49 user nova-compute[74131]:     <acpi/>
Oct 20 16:31:49 user nova-compute[74131]:     <apic/>
Oct 20 16:31:49 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:31:49 user nova-compute[74131]:   </features>
Oct 20 16:31:49 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:31:49 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:31:49 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:31:49 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:31:49 user nova-compute[74131]:   </clock>
Oct 20 16:31:49 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:31:49 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:31:49 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:31:49 user nova-compute[74131]:   </cpu>
Oct 20 16:31:49 user nova-compute[74131]:   <devices>
Oct 20 16:31:49 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:31:49 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:31:49 user nova-compute[74131]:       <source dev="/dev/sdc"/>
Oct 20 16:31:49 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:31:49 user nova-compute[74131]:       <serial>48da990f-1ed3-4d55-b607-f5bb688f72fe</serial>
Oct 20 16:31:49 user nova-compute[74131]:     </disk>
Oct 20 16:31:49 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:31:49 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:31:49 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue"/>
Oct 20 16:31:49 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:31:49 user nova-compute[74131]:       <boot order="1"/>
Oct 20 16:31:49 user nova-compute[74131]:     </disk>
Oct 20 16:31:49 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:31:49 user nova-compute[74131]:       <mac address="fa:16:3e:c7:90:5d"/>
Oct 20 16:31:49 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:49 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:31:49 user nova-compute[74131]:       <target dev="tap464ba822-ba"/>
Oct 20 16:31:49 user nova-compute[74131]:     </interface>
Oct 20 16:31:49 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:31:49 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/console.log" append="off"/>
Oct 20 16:31:49 user nova-compute[74131]:     </serial>
Oct 20 16:31:49 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:31:49 user nova-compute[74131]:     <video>
Oct 20 16:31:49 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:31:49 user nova-compute[74131]:     </video>
Oct 20 16:31:49 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:31:49 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:31:49 user nova-compute[74131]:     </rng>
Oct 20 16:31:49 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:31:49 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:31:49 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:31:49 user nova-compute[74131]:     </memballoon>
Oct 20 16:31:49 user nova-compute[74131]:   </devices>
Oct 20 16:31:49 user nova-compute[74131]: </domain>
Oct 20 16:31:49 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:31:49 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance destroyed successfully.
Oct 20 16:31:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:31:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:31:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No VIF found with MAC fa:16:3e:c7:90:5d, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:31:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:50 user nova-compute[74131]: INFO nova.compute.manager [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Rebuilding instance
Oct 20 16:31:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-41aa73b2-33e3-42a4-bca3-fb259fcc7a3b req-a59deb41-3c4d-43ef-af6f-3160f7727c09 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-41aa73b2-33e3-42a4-bca3-fb259fcc7a3b req-a59deb41-3c4d-43ef-af6f-3160f7727c09 service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-41aa73b2-33e3-42a4-bca3-fb259fcc7a3b req-a59deb41-3c4d-43ef-af6f-3160f7727c09 service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-41aa73b2-33e3-42a4-bca3-fb259fcc7a3b req-a59deb41-3c4d-43ef-af6f-3160f7727c09 service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-41aa73b2-33e3-42a4-bca3-fb259fcc7a3b req-a59deb41-3c4d-43ef-af6f-3160f7727c09 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:51 user nova-compute[74131]: WARNING nova.compute.manager [req-41aa73b2-33e3-42a4-bca3-fb259fcc7a3b req-a59deb41-3c4d-43ef-af6f-3160f7727c09 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuilding.
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance destroyed successfully.
Oct 20 16:31:52 user nova-compute[74131]: INFO nova.compute.manager [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Detaching volume a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:31:52 user nova-compute[74131]: INFO nova.virt.block_device [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Attempting to driver detach volume a643ef59-b981-424c-9cd8-e1226055399e from mountpoint /dev/vdb
Oct 20 16:31:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Attempting to detach device vdb from instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:31:52 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:31:52 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:31:52 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:31:52 user nova-compute[74131]:   <serial>a643ef59-b981-424c-9cd8-e1226055399e</serial>
Oct 20 16:31:52 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:31:52 user nova-compute[74131]: </disk>
Oct 20 16:31:52 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully detached device vdb from instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 from the persistent domain config.
Oct 20 16:31:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:52 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a590b3c-2906-47e0-bf32-9e85e568b707]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:31:52 user nova-compute[74131]: No targets found.
Oct 20 16:31:52 user nova-compute[74131]: iSNS:
Oct 20 16:31:52 user nova-compute[74131]: No targets found.
Oct 20 16:31:52 user nova-compute[74131]: STATIC:
Oct 20 16:31:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01
Oct 20 16:31:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:31:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0
Oct 20 16:31:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:31:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:52 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:31:52 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:52 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:52 user nova-compute[74131]: FIRMWARE:
Oct 20 16:31:52 user nova-compute[74131]: No targets found.
Oct 20 16:31:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:31:52 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:31:52 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ded9df-269f-4bb9-9d28-f4d8f23968cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a51d1a5-0d32-462d-804c-8a2259dedd3a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:31:52 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8784e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc598850-97b9-4d65-8e0f-846ef384ce63]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec0036-329e-4246-bb8d-a91021a5cebd]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f047b2f4-6fc1-4d1b-912f-1d386fe945fa]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.078s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa90054-9639-4721-8afb-7d072f499fe1]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dedbc59-0b83-45e1-a9be-d90b5f5ea523]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa767e-b19b-4f07-8855-36832ab6549d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]
Oct 20 16:31:52 user nova-compute[74131]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.
Oct 20 16:31:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafad86c-ca76-44ee-9d65-2d1dd041287f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== disconnect_volume: return (434ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuilding.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuilding.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuilding.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuilding.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuilding.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received unexpected event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with vm_state building and task_state spawning.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received unexpected event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with vm_state building and task_state spawning.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state active and task_state rescuing.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING nova.compute.manager [req-2e85fe7b-37d8-4413-b2ee-39a07819cdb7 req-d2d31e78-8323-4cee-b2d1-f2933c7b9d0b service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state active and task_state rescuing.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance destroyed successfully.
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-922119915',display_name='tempest-ServerActionsTestOtherA-server-1571890221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-922119915',id=22,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClsw25KmejLndYBIRuFDpZeoBzz0XFoBnGaNFpUkFZ2ueCXES09aknXNcKDwgLJ0hSqiuxQFmvUMbjJI9W+CvysCsH9vDWL9/yf5HU69VDrewq3TaRiKAWilU8ELN8rSg==',key_name='tempest-keypair-41371766',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-p30mggky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=4fdc0030-fba0-4beb-bfd5-b1179c1868a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_vif [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e77cb4a-26, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2a3acae-e15e-4341-b3e0-b9d26281e62e) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:31:53 user nova-compute[74131]: INFO os_vif [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26')
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:53 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca0200c-0cb6-4db3-a88f-c9d48f4a3208]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:31:53 user nova-compute[74131]: No targets found.
Oct 20 16:31:53 user nova-compute[74131]: iSNS:
Oct 20 16:31:53 user nova-compute[74131]: No targets found.
Oct 20 16:31:53 user nova-compute[74131]: STATIC:
Oct 20 16:31:53 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01
Oct 20 16:31:53 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:53 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:53 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:31:53 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:53 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:53 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0
Oct 20 16:31:53 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:53 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:53 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:31:53 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:31:53 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:31:53 user nova-compute[74131]: FIRMWARE:
Oct 20 16:31:53 user nova-compute[74131]: No targets found.
Oct 20 16:31:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:31:53 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:31:53 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab51b8-acfa-431e-8faf-c764c59fb745]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c526d3-e3f7-4fd6-811b-dad83a8b7949]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:53 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:53 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:53 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:31:53 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:31:53 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:31:53 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:31:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c82e16c0>, {}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Disconnecting from: [] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== disconnect_volume: return (87ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:31:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Deleting instance files /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1_del
Oct 20 16:31:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Deletion of /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1_del complete
Oct 20 16:31:54 user nova-compute[74131]: INFO nova.virt.block_device [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Booting with volume a643ef59-b981-424c-9cd8-e1226055399e at /dev/vdb
Oct 20 16:31:54 user nova-compute[74131]: DEBUG os_brick.utils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa5308-2f70-48f4-8cd3-e8734f1e1a6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[351af589-026a-4c35-83f6-06b8ef98dbf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[42176218-a3df-4324-90ce-2b75b3b3067c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c09c70-88b9-4aad-b710-f84c4136723e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:31:54 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:31:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[335dfbf5-3245-4448-ad0f-6230c61d7115]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG os_brick.utils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:31:54 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating existing volume attachment record: 6ae7d34b-79a3-4960-af7b-b0b15a0a1a17 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-ae17506f-cd5c-4f29-b7e3-c1875cc5ca2a tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:31:55 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance spawned successfully.
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:31:55 user nova-compute[74131]: INFO nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Took 9.48 seconds to spawn the instance on the hypervisor.
Oct 20 16:31:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:31:55 user nova-compute[74131]: INFO nova.compute.manager [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Took 49.43 seconds to build instance.
Oct 20 16:31:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-990b8ce9-706d-40f3-859f-bea27c390158 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.542s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:31:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:06 user nova-compute[74131]: INFO nova.compute.manager [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Detaching volume 7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0
Oct 20 16:32:06 user nova-compute[74131]: INFO nova.virt.block_device [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Attempting to driver detach volume 7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 from mountpoint /dev/vdc
Oct 20 16:32:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Attempting to detach device vdc from instance 52b4f002-76fb-45c7-8b60-25c56d40740c from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:32:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:32:06 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:32:06 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:32:06 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:32:06 user nova-compute[74131]:   <serial>7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0</serial>
Oct 20 16:32:06 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 16:32:06 user nova-compute[74131]: </disk>
Oct 20 16:32:06 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:32:06 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully detached device vdc from instance 52b4f002-76fb-45c7-8b60-25c56d40740c from the persistent domain config.
Oct 20 16:32:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 52b4f002-76fb-45c7-8b60-25c56d40740c from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:32:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:32:06 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:32:06 user nova-compute[74131]:   <source dev="/dev/sdd"/>
Oct 20 16:32:06 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:32:06 user nova-compute[74131]:   <serial>7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0</serial>
Oct 20 16:32:06 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 16:32:06 user nova-compute[74131]: </disk>
Oct 20 16:32:06 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:32:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:32:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:32:13 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Creating image(s)
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.214s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk 1073741824" returned: 0 in 0.051s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:32:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Cannot resize image /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Ensure instance console log exists: /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Start _get_guest_xml network_info=[{"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6ae7d34b-79a3-4960-af7b-b0b15a0a1a17', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4fdc0030-fba0-4beb-bfd5-b1179c1868a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a643ef59-b981-424c-9cd8-e1226055399e', 'serial': 'a643ef59-b981-424c-9cd8-e1226055399e'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:32:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 16:32:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:32:14 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:32:14 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:32:14 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb27363-f71d-4a94-b079-87d9d2e828a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:32:14 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f96656e-fccc-4ebb-be85-32e9d4a677c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e] added
Oct 20 16:32:14 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e198e0-75d7-45c2-9a7e-508d78c2e9da]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d2ba5-49f8-465d-8066-30ebac27d7f2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVtcMveW {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVtcMveW" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f40084-011e-444c-922e-d98e86f150a7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uVtcMveW'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64f379-ab00-4874-9769-eb1ad05628d0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5a9915-f923-4c42-bddd-eeba0eaa90db]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4eaed5-591a-489c-a2a5-6deaac5110b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]
Oct 20 16:32:14 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.
Oct 20 16:32:14 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef0eba-eabe-4428-8806-f5a3ddf2a588]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b5e688-54a9-44e4-bd45-881d30868468]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:14 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:14 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:14 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[08056de1-1b7e-48d4-b285-5f5ba3a77111]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:14 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26266346362313565', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266346362313565', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-922119915',display_name='tempest-ServerActionsTestOtherA-server-1571890221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-922119915',id=22,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClsw25KmejLndYBIRuFDpZeoBzz0XFoBnGaNFpUkFZ2ueCXES09aknXNcKDwgLJ0hSqiuxQFmvUMbjJI9W+CvysCsH9vDWL9/yf5HU69VDrewq3TaRiKAWilU8ELN8rSg==',key_name='tempest-keypair-41371766',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-p30mggky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=4fdc0030-fba0-4beb-bfd5-b1179c1868a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:32:15 user nova-compute[74131]:   <uuid>4fdc0030-fba0-4beb-bfd5-b1179c1868a1</uuid>
Oct 20 16:32:15 user nova-compute[74131]:   <name>instance-00000016</name>
Oct 20 16:32:15 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:32:15 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:32:15 user nova-compute[74131]:   <metadata>
Oct 20 16:32:15 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:32:15 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:32:15 user nova-compute[74131]:       <nova:name>tempest-ServerActionsTestOtherA-server-1571890221</nova:name>
Oct 20 16:32:15 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:32:14</nova:creationTime>
Oct 20 16:32:15 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:32:15 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:32:15 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:32:15 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:32:15 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:32:15 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:32:15 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:32:15 user nova-compute[74131]:       <nova:owner>
Oct 20 16:32:15 user nova-compute[74131]:         <nova:user uuid="2f6bff83a2e24a289333823acf911ccd">tempest-ServerActionsTestOtherA-844175334-project-member</nova:user>
Oct 20 16:32:15 user nova-compute[74131]:         <nova:project uuid="69db8a4e064f445abd0a8555aaa18b88">tempest-ServerActionsTestOtherA-844175334</nova:project>
Oct 20 16:32:15 user nova-compute[74131]:       </nova:owner>
Oct 20 16:32:15 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:32:15 user nova-compute[74131]:       <nova:ports>
Oct 20 16:32:15 user nova-compute[74131]:         <nova:port uuid="9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e">
Oct 20 16:32:15 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 16:32:15 user nova-compute[74131]:         </nova:port>
Oct 20 16:32:15 user nova-compute[74131]:       </nova:ports>
Oct 20 16:32:15 user nova-compute[74131]:     </nova:instance>
Oct 20 16:32:15 user nova-compute[74131]:   </metadata>
Oct 20 16:32:15 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:32:15 user nova-compute[74131]:     <system>
Oct 20 16:32:15 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:32:15 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:32:15 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:32:15 user nova-compute[74131]:       <entry name="serial">4fdc0030-fba0-4beb-bfd5-b1179c1868a1</entry>
Oct 20 16:32:15 user nova-compute[74131]:       <entry name="uuid">4fdc0030-fba0-4beb-bfd5-b1179c1868a1</entry>
Oct 20 16:32:15 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:32:15 user nova-compute[74131]:     </system>
Oct 20 16:32:15 user nova-compute[74131]:   </sysinfo>
Oct 20 16:32:15 user nova-compute[74131]:   <os>
Oct 20 16:32:15 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:32:15 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:32:15 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:32:15 user nova-compute[74131]:   </os>
Oct 20 16:32:15 user nova-compute[74131]:   <features>
Oct 20 16:32:15 user nova-compute[74131]:     <acpi/>
Oct 20 16:32:15 user nova-compute[74131]:     <apic/>
Oct 20 16:32:15 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:32:15 user nova-compute[74131]:   </features>
Oct 20 16:32:15 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:32:15 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:32:15 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:32:15 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:32:15 user nova-compute[74131]:   </clock>
Oct 20 16:32:15 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:32:15 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:32:15 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:32:15 user nova-compute[74131]:   </cpu>
Oct 20 16:32:15 user nova-compute[74131]:   <devices>
Oct 20 16:32:15 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:32:15 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:32:15 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk"/>
Oct 20 16:32:15 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:32:15 user nova-compute[74131]:     </disk>
Oct 20 16:32:15 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:32:15 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:32:15 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 16:32:15 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:32:15 user nova-compute[74131]:       <serial>a643ef59-b981-424c-9cd8-e1226055399e</serial>
Oct 20 16:32:15 user nova-compute[74131]:     </disk>
Oct 20 16:32:15 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:32:15 user nova-compute[74131]:       <mac address="fa:16:3e:78:ef:ca"/>
Oct 20 16:32:15 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:32:15 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:32:15 user nova-compute[74131]:       <target dev="tap9e77cb4a-26"/>
Oct 20 16:32:15 user nova-compute[74131]:     </interface>
Oct 20 16:32:15 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:32:15 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/console.log" append="off"/>
Oct 20 16:32:15 user nova-compute[74131]:     </serial>
Oct 20 16:32:15 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:32:15 user nova-compute[74131]:     <video>
Oct 20 16:32:15 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:32:15 user nova-compute[74131]:     </video>
Oct 20 16:32:15 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:32:15 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:32:15 user nova-compute[74131]:     </rng>
Oct 20 16:32:15 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:32:15 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:32:15 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:32:15 user nova-compute[74131]:     </memballoon>
Oct 20 16:32:15 user nova-compute[74131]:   </devices>
Oct 20 16:32:15 user nova-compute[74131]: </domain>
Oct 20 16:32:15 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-922119915',display_name='tempest-ServerActionsTestOtherA-server-1571890221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-922119915',id=22,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClsw25KmejLndYBIRuFDpZeoBzz0XFoBnGaNFpUkFZ2ueCXES09aknXNcKDwgLJ0hSqiuxQFmvUMbjJI9W+CvysCsH9vDWL9/yf5HU69VDrewq3TaRiKAWilU8ELN8rSg==',key_name='tempest-keypair-41371766',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-p30mggky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=4fdc0030-fba0-4beb-bfd5-b1179c1868a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG os_vif [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93a13243-93b7-59c3-b2cc-827860032715', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e77cb4a-26, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e77cb4a-26, col_values=(('qos', UUID('86e2f5da-5723-40c4-b903-921ec3c3b3bd')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e77cb4a-26, col_values=(('external_ids', {'iface-id': '9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:ef:ca', 'vm-uuid': '4fdc0030-fba0-4beb-bfd5-b1179c1868a1'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:15 user nova-compute[74131]: INFO os_vif [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26')
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:32:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No VIF found with MAC fa:16:3e:78:ef:ca, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:32:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-b68ec0ce-48f0-4961-abd3-5b779f1e85e9 req-506af9ee-cba5-4655-ae26-791b941b284e service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b68ec0ce-48f0-4961-abd3-5b779f1e85e9 req-506af9ee-cba5-4655-ae26-791b941b284e service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b68ec0ce-48f0-4961-abd3-5b779f1e85e9 req-506af9ee-cba5-4655-ae26-791b941b284e service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b68ec0ce-48f0-4961-abd3-5b779f1e85e9 req-506af9ee-cba5-4655-ae26-791b941b284e service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-b68ec0ce-48f0-4961-abd3-5b779f1e85e9 req-506af9ee-cba5-4655-ae26-791b941b284e service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:17 user nova-compute[74131]: WARNING nova.compute.manager [req-b68ec0ce-48f0-4961-abd3-5b779f1e85e9 req-506af9ee-cba5-4655-ae26-791b941b284e service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuild_spawning.
Oct 20 16:32:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:32:19 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance spawned successfully.
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-b7117c1d-d1b2-408c-972d-0183d6e61eda req-cc492966-ee2b-4804-81d9-b46ee16c702c service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b7117c1d-d1b2-408c-972d-0183d6e61eda req-cc492966-ee2b-4804-81d9-b46ee16c702c service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b7117c1d-d1b2-408c-972d-0183d6e61eda req-cc492966-ee2b-4804-81d9-b46ee16c702c service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b7117c1d-d1b2-408c-972d-0183d6e61eda req-cc492966-ee2b-4804-81d9-b46ee16c702c service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-b7117c1d-d1b2-408c-972d-0183d6e61eda req-cc492966-ee2b-4804-81d9-b46ee16c702c service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:19 user nova-compute[74131]: WARNING nova.compute.manager [req-b7117c1d-d1b2-408c-972d-0183d6e61eda req-cc492966-ee2b-4804-81d9-b46ee16c702c service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state rebuild_spawning.
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG nova.objects.instance [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74131) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 16:32:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d3234ad2-e4ad-49ed-a25a-ac310da63c46 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.088s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:32:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:32:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:32:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:32:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:32:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:32:24 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 151335d8-e828-425b-8422-ba047749b204 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Updating instance_info_cache with network_info: [{"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-151335d8-e828-425b-8422-ba047749b204" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 151335d8-e828-425b-8422-ba047749b204] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:32:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 52b4f002-76fb-45c7-8b60-25c56d40740c is timed out.
Oct 20 16:32:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully detached device vdc from instance 52b4f002-76fb-45c7-8b60-25c56d40740c from the live domain config.
Oct 20 16:32:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxwJRIZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:32:27 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a5042d-8672-4d33-ad38-02d2ff4fd33e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:32:27 user nova-compute[74131]: No targets found.
Oct 20 16:32:27 user nova-compute[74131]: iSNS:
Oct 20 16:32:27 user nova-compute[74131]: No targets found.
Oct 20 16:32:27 user nova-compute[74131]: STATIC:
Oct 20 16:32:27 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01
Oct 20 16:32:27 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:32:27 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:32:27 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:32:27 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:32:27 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:32:27 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0
Oct 20 16:32:27 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:32:27 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:32:27 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:32:27 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:32:27 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:32:27 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:32:27 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:32:27 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:32:27 user nova-compute[74131]: FIRMWARE:
Oct 20 16:32:27 user nova-compute[74131]: No targets found.
Oct 20 16:32:27 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:32:27 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:32:27 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80936d2-0c4b-4aa1-abb1-57774d271d7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ddac0c-40d7-487e-98b5-4e42c3e1c748]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:27 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:27 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:27 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87a8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0'): ({'sdd'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Removing single pathed devices sdd {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc44f7-acf3-4a88-bcea-c68d581e218b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eca7d0-0f46-42c4-9eaf-bd3b3e6a8b74]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flushing IO for device /dev/sdd {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e311a0-f100-43d5-bb46-3335d81ffc75]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[514e207c-e2d3-41cd-ad47-a380bfaad19f]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0ecc22-82ca-4f9f-b9d1-025aeafb96d4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f80835-2f39-4920-8d22-08bdb028dd78]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260]
Oct 20 16:32:27 user nova-compute[74131]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0, portal: 172.16.0.220,3260] successful.
Oct 20 16:32:27 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce826ac-fcf0-4b6d-8726-7a2a1cc2fbc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[365a17f6-e5f8-40f3-8725-4aa9f076a555]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] <== disconnect_volume: return (398ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:32:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG nova.objects.instance [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'flavor' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2b384654-1d6b-4338-a02d-cbda4da585da tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:31 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:32:31 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7165MB free_disk=25.034934997558594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 151335d8-e828-425b-8422-ba047749b204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 52b4f002-76fb-45c7-8b60-25c56d40740c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 42233b10-3752-4adf-89de-7ebe52bd1e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:32:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "151335d8-e828-425b-8422-ba047749b204" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "151335d8-e828-425b-8422-ba047749b204" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "151335d8-e828-425b-8422-ba047749b204-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "151335d8-e828-425b-8422-ba047749b204-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "151335d8-e828-425b-8422-ba047749b204-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:36 user nova-compute[74131]: INFO nova.compute.manager [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Terminating instance
Oct 20 16:32:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-708fa408-a255-4cd6-a9d3-e8f729b42bd5 req-6284e7de-b9d1-4427-8d16-3c21227ca17b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received event network-vif-unplugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-708fa408-a255-4cd6-a9d3-e8f729b42bd5 req-6284e7de-b9d1-4427-8d16-3c21227ca17b service nova] Acquiring lock "151335d8-e828-425b-8422-ba047749b204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-708fa408-a255-4cd6-a9d3-e8f729b42bd5 req-6284e7de-b9d1-4427-8d16-3c21227ca17b service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-708fa408-a255-4cd6-a9d3-e8f729b42bd5 req-6284e7de-b9d1-4427-8d16-3c21227ca17b service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-708fa408-a255-4cd6-a9d3-e8f729b42bd5 req-6284e7de-b9d1-4427-8d16-3c21227ca17b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] No waiting events found dispatching network-vif-unplugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-708fa408-a255-4cd6-a9d3-e8f729b42bd5 req-6284e7de-b9d1-4427-8d16-3c21227ca17b service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received event network-vif-unplugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:32:37 user nova-compute[74131]: INFO nova.compute.claims [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Claim successful on node user
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 151335d8-e828-425b-8422-ba047749b204] Instance destroyed successfully.
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.objects.instance [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lazy-loading 'resources' on Instance uuid 151335d8-e828-425b-8422-ba047749b204 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505746337',display_name='tempest-ServersNegativeTestJSON-server-505746337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505746337',id=13,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5bc52c1d965465687699b8e0118300b',ramdisk_id='',reservation_id='r-pqhno65p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-270953747',owner_user_name='tempest-ServersNegativeTestJSON-270953747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:23:36Z,user_data=None,user_id='757415037269406cbc1dfe3de4465c53',uuid=151335d8-e828-425b-8422-ba047749b204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converting VIF {"id": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "address": "fa:16:3e:e0:6f:d1", "network": {"id": "7bf373d1-584b-4319-ae40-794a13647fa7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1374541169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bc52c1d965465687699b8e0118300b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5b62c4-93", "ovs_interfaceid": "fd5b62c4-93b6-4ac8-b2f0-6a8efe819634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=fd5b62c4-93b6-4ac8-b2f0-6a8efe819634,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5b62c4-93') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG os_vif [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=fd5b62c4-93b6-4ac8-b2f0-6a8efe819634,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5b62c4-93') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd5b62c4-93, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d7aaf21-1ed4-41b6-a862-edbbe679881a) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:37 user nova-compute[74131]: INFO os_vif [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=fd5b62c4-93b6-4ac8-b2f0-6a8efe819634,network=Network(7bf373d1-584b-4319-ae40-794a13647fa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5b62c4-93')
Oct 20 16:32:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Deleting instance files /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204_del
Oct 20 16:32:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Deletion of /opt/stack/data/nova/instances/151335d8-e828-425b-8422-ba047749b204_del complete
Oct 20 16:32:37 user nova-compute[74131]: INFO nova.compute.manager [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] [instance: 151335d8-e828-425b-8422-ba047749b204] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 151335d8-e828-425b-8422-ba047749b204] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 151335d8-e828-425b-8422-ba047749b204] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:32:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:32:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG nova.policy [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c0f3a5e9862491897ec87644c577ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08267e8d79941d3a555dc3a51c58985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:32:38 user nova-compute[74131]: INFO nova.virt.block_device [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Booting with volume 84a36ee8-2b74-44d4-9096-f43fa2aa6070 at /dev/vda
Oct 20 16:32:38 user nova-compute[74131]: DEBUG os_brick.utils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e2f8f-3016-4b1b-8e2f-98b40f53bbc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa0d367-766e-4042-8922-a0695f4e5d4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e40e184-aa5b-46e3-9e26-67bc65603e37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8834ce6-88e1-4f82-978e-6e8af5f83724]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:32:38 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eb0850-bdea-4978-bf5b-2b9922d621e1]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG os_brick.utils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Updating existing volume attachment record: 8751e29b-1972-46db-b34c-f92e4f43400a {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 151335d8-e828-425b-8422-ba047749b204] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:38 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 151335d8-e828-425b-8422-ba047749b204] Took 0.60 seconds to deallocate network for instance.
Oct 20 16:32:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-d4e29283-1f5d-458c-b71c-0261d3b7a930 req-e7e3f61c-a5a8-41e4-82f1-9d9fa24aa9c9 service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received event network-vif-deleted-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Successfully created port: 02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:32:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:38 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Deleted allocations for instance 151335d8-e828-425b-8422-ba047749b204
Oct 20 16:32:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d8a3f93f-6044-432c-9b20-d3690a236e76 tempest-ServersNegativeTestJSON-270953747 tempest-ServersNegativeTestJSON-270953747-project-member] Lock "151335d8-e828-425b-8422-ba047749b204" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-398e7b97-ba42-4eeb-9db4-319ef6b36330 req-f7e7dd6c-cdc2-41c9-9a65-c0ab3125469f service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received event network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-398e7b97-ba42-4eeb-9db4-319ef6b36330 req-f7e7dd6c-cdc2-41c9-9a65-c0ab3125469f service nova] Acquiring lock "151335d8-e828-425b-8422-ba047749b204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-398e7b97-ba42-4eeb-9db4-319ef6b36330 req-f7e7dd6c-cdc2-41c9-9a65-c0ab3125469f service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-398e7b97-ba42-4eeb-9db4-319ef6b36330 req-f7e7dd6c-cdc2-41c9-9a65-c0ab3125469f service nova] Lock "151335d8-e828-425b-8422-ba047749b204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-398e7b97-ba42-4eeb-9db4-319ef6b36330 req-f7e7dd6c-cdc2-41c9-9a65-c0ab3125469f service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] No waiting events found dispatching network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:39 user nova-compute[74131]: WARNING nova.compute.manager [req-398e7b97-ba42-4eeb-9db4-319ef6b36330 req-f7e7dd6c-cdc2-41c9-9a65-c0ab3125469f service nova] [instance: 151335d8-e828-425b-8422-ba047749b204] Received unexpected event network-vif-plugged-fd5b62c4-93b6-4ac8-b2f0-6a8efe819634 for instance with vm_state deleted and task_state None.
Oct 20 16:32:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Successfully updated port: 02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquired lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Updating instance_info_cache with network_info: [{"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Releasing lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:32:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Instance network_info: |[{"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:32:40 user nova-compute[74131]: INFO nova.compute.manager [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Unrescuing
Oct 20 16:32:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG nova.network.neutron [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG nova.network.neutron [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG nova.objects.instance [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'flavor' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing instance network info cache due to event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG nova.network.neutron [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:32:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance destroyed successfully.
Oct 20 16:32:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-changed-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Refreshing instance network info cache due to event network-changed-02c962b1-cd04-4515-9995-ede3554c6f07. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Acquiring lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Acquired lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:32:41 user nova-compute[74131]: DEBUG nova.network.neutron [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Refreshing network info cache for port 02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Updated VIF entry in instance network info cache for port 02c962b1-cd04-4515-9995-ede3554c6f07. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Updating instance_info_cache with network_info: [{"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updated VIF entry in instance network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Releasing lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:42 user nova-compute[74131]: WARNING nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:42 user nova-compute[74131]: WARNING nova.compute.manager [req-d64df2c7-df87-4965-8369-1a32c0a9044c req-a1435d98-64a9-415c-903b-88bf5b09d8dd service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:32:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-49515e0f-e7c2-4447-9aa2-f8f9e8c4c6eb req-ef03bbba-636c-4282-b5b7-f9d888f24e89 service nova] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing instance network info cache due to event network-changed-3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] Acquiring lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] Acquired lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Refreshing network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:43 user nova-compute[74131]: WARNING nova.compute.manager [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:43 user nova-compute[74131]: WARNING nova.compute.manager [req-9b85d33a-46da-4bb9-ab3f-56ef0b01e45a req-7f5f4e3c-3a12-4f98-ae75-66bb3c7cd7ef service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updated VIF entry in instance network info cache for port 3058f4d2-f621-46ec-b677-b5161dba512f. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [{"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-45961ffe-b351-47c9-bede-1dafc48b6c23 req-4c0e7894-5fca-48a2-b5d3-b77d675c6ac1 service nova] Releasing lock "refresh_cache-9ff2e5d8-f854-4f8b-941f-17ba5e47caff" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:32:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-839a001e-fc68-4e75-b318-8cee03adcdc7 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:32:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "42233b10-3752-4adf-89de-7ebe52bd1e02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:48 user nova-compute[74131]: INFO nova.compute.manager [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Terminating instance
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-95ab5009-5d7d-4f52-a43f-37f898f828f8 req-7d2ef692-4620-4dab-8be9-e11c1ca0e7ea service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received event network-vif-unplugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-95ab5009-5d7d-4f52-a43f-37f898f828f8 req-7d2ef692-4620-4dab-8be9-e11c1ca0e7ea service nova] Acquiring lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-95ab5009-5d7d-4f52-a43f-37f898f828f8 req-7d2ef692-4620-4dab-8be9-e11c1ca0e7ea service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-95ab5009-5d7d-4f52-a43f-37f898f828f8 req-7d2ef692-4620-4dab-8be9-e11c1ca0e7ea service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-95ab5009-5d7d-4f52-a43f-37f898f828f8 req-7d2ef692-4620-4dab-8be9-e11c1ca0e7ea service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] No waiting events found dispatching network-vif-unplugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-95ab5009-5d7d-4f52-a43f-37f898f828f8 req-7d2ef692-4620-4dab-8be9-e11c1ca0e7ea service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received event network-vif-unplugged-db82a2a6-d338-44f7-9930-789831fda427 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Instance destroyed successfully.
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lazy-loading 'resources' on Instance uuid 42233b10-3752-4adf-89de-7ebe52bd1e02 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-999764633',display_name='tempest-VolumesAdminNegativeTest-server-999764633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-999764633',id=25,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:30:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dfddd1bd2cd4dde9c2fede4e4d6aa00',ramdisk_id='',reservation_id='r-befh1yt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-651596449',owner_user_name='tempest-VolumesAdminNegativeTest-651596449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:30:49Z,user_data=None,user_id='27db8d4c54ec453b95a9a0de35d18fe3',uuid=42233b10-3752-4adf-89de-7ebe52bd1e02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converting VIF {"id": "db82a2a6-d338-44f7-9930-789831fda427", "address": "fa:16:3e:65:88:71", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb82a2a6-d3", "ovs_interfaceid": "db82a2a6-d338-44f7-9930-789831fda427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:71,bridge_name='br-int',has_traffic_filtering=True,id=db82a2a6-d338-44f7-9930-789831fda427,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb82a2a6-d3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG os_vif [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:71,bridge_name='br-int',has_traffic_filtering=True,id=db82a2a6-d338-44f7-9930-789831fda427,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb82a2a6-d3') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb82a2a6-d3, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b8bf2ce-62aa-44c8-b149-c13007e38a4e) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:48 user nova-compute[74131]: INFO os_vif [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:71,bridge_name='br-int',has_traffic_filtering=True,id=db82a2a6-d338-44f7-9930-789831fda427,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb82a2a6-d3')
Oct 20 16:32:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Deleting instance files /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02_del
Oct 20 16:32:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Deletion of /opt/stack/data/nova/instances/42233b10-3752-4adf-89de-7ebe52bd1e02_del complete
Oct 20 16:32:48 user nova-compute[74131]: INFO nova.compute.manager [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 16:32:48 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:32:48 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:32:49 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:49 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Took 0.54 seconds to deallocate network for instance.
Oct 20 16:32:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:49 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:32:49 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:32:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:50 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Deleted allocations for instance 42233b10-3752-4adf-89de-7ebe52bd1e02
Oct 20 16:32:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bab08516-8620-4a76-a7ce-6ac5834d413c tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-f3b966a1-9b9c-4870-ae4f-7e93b18cbae3 req-07db9786-e8a0-49bd-8beb-ee7aaee39b61 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received event network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f3b966a1-9b9c-4870-ae4f-7e93b18cbae3 req-07db9786-e8a0-49bd-8beb-ee7aaee39b61 service nova] Acquiring lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f3b966a1-9b9c-4870-ae4f-7e93b18cbae3 req-07db9786-e8a0-49bd-8beb-ee7aaee39b61 service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f3b966a1-9b9c-4870-ae4f-7e93b18cbae3 req-07db9786-e8a0-49bd-8beb-ee7aaee39b61 service nova] Lock "42233b10-3752-4adf-89de-7ebe52bd1e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-f3b966a1-9b9c-4870-ae4f-7e93b18cbae3 req-07db9786-e8a0-49bd-8beb-ee7aaee39b61 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] No waiting events found dispatching network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:50 user nova-compute[74131]: WARNING nova.compute.manager [req-f3b966a1-9b9c-4870-ae4f-7e93b18cbae3 req-07db9786-e8a0-49bd-8beb-ee7aaee39b61 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received unexpected event network-vif-plugged-db82a2a6-d338-44f7-9930-789831fda427 for instance with vm_state deleted and task_state None.
Oct 20 16:32:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-f3b966a1-9b9c-4870-ae4f-7e93b18cbae3 req-07db9786-e8a0-49bd-8beb-ee7aaee39b61 service nova] [instance: 42233b10-3752-4adf-89de-7ebe52bd1e02] Received event network-vif-deleted-db82a2a6-d338-44f7-9930-789831fda427 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:57 user nova-compute[74131]: INFO nova.compute.manager [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Terminating instance
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-efece673-cf8c-45c1-b8bc-8620c6b5bd91 req-22fe53cb-96d8-4e2e-b542-49ddd04eab9d service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-unplugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-efece673-cf8c-45c1-b8bc-8620c6b5bd91 req-22fe53cb-96d8-4e2e-b542-49ddd04eab9d service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-efece673-cf8c-45c1-b8bc-8620c6b5bd91 req-22fe53cb-96d8-4e2e-b542-49ddd04eab9d service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-efece673-cf8c-45c1-b8bc-8620c6b5bd91 req-22fe53cb-96d8-4e2e-b542-49ddd04eab9d service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-efece673-cf8c-45c1-b8bc-8620c6b5bd91 req-22fe53cb-96d8-4e2e-b542-49ddd04eab9d service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-unplugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-efece673-cf8c-45c1-b8bc-8620c6b5bd91 req-22fe53cb-96d8-4e2e-b542-49ddd04eab9d service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-unplugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:32:57 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Creating image(s)
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Ensure instance console log exists: /opt/stack/data/nova/instances/7146dad8-b7e6-4d2f-9774-148d3ddda54e/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Start _get_guest_xml network_info=[{"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8751e29b-1972-46db-b34c-f92e4f43400a', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhwOJxoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7146dad8-b7e6-4d2f-9774-148d3ddda54e', 'attached_at': '', 'detached_at': '', 'volume_id': '84a36ee8-2b74-44d4-9096-f43fa2aa6070', 'serial': '84a36ee8-2b74-44d4-9096-f43fa2aa6070'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:32:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:32:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhwOJxoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:32:57 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:32:57 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:32:57 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[076240c0-7e88-49b2-852f-16d076dd3778]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:32:57 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7f2e43-74fc-4904-9699-66da106453e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070] added
Oct 20 16:32:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee6cb78-456e-42ba-9959-8819993d0247]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44dab4d-7a10-4f41-8293-199db8ad093b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhwOJxoR {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhwOJxoR" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90db54a-8161-44ce-a218-7ae27b961929]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GhwOJxoR'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b257da-7e26-4e6c-8e89-933194f3f329]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45b35a6-f345-4a47-9074-3812caec1ad1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[60791f5f-41d2-40a9-8808-dcea13e5c4fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260]
Oct 20 16:32:57 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260] successful.
Oct 20 16:32:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d210c-f519-474a-ac71-68af90647b71]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a82a5a-70a7-496b-bce6-d9fdb52f2918]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:32:57 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:32:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:32:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e36fa45-ac51-4cc8-88ea-afb5da208e91]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhwOJxoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:32:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Instance destroyed successfully.
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.objects.instance [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'resources' on Instance uuid 52b4f002-76fb-45c7-8b60-25c56d40740c {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-976985580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-976985580',id=16,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVp9HZPyBmzXnZTVreymlvmqKM0FHfm/W5XKKYwI1AtVnw/zg7hXFbiOVKCYyHrV1fysjXPYeiMHX8blrvhaCQIboEP/l4Knd5znTivp0fMjMxKFUiZ2PARnMXKugz+iw==',key_name='tempest-keypair-1923835951',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:30:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-qaz16zij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=52b4f002-76fb-45c7-8b60-25c56d40740c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "address": "fa:16:3e:cf:c6:30", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b904706-24", "ovs_interfaceid": "6b904706-24ea-4eb8-93d6-577ddeaef64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG os_vif [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b904706-24, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07f34e3f-60fc-4594-9577-eb799987a2a1) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:58 user nova-compute[74131]: INFO os_vif [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=6b904706-24ea-4eb8-93d6-577ddeaef64b,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b904706-24')
Oct 20 16:32:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Deleting instance files /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c_del
Oct 20 16:32:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Deletion of /opt/stack/data/nova/instances/52b4f002-76fb-45c7-8b60-25c56d40740c_del complete
Oct 20 16:32:58 user nova-compute[74131]: INFO nova.compute.manager [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 20 16:32:58 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing instance network info cache due to event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:32:58 user nova-compute[74131]: DEBUG nova.network.neutron [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26638333938666462', 'path': '/dev/sdd'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333938666462', 'path': '/dev/sdd'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1931189949',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1931189949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1931189949',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7FU1yXKJDnPDiSPVp1byP7mCUYNa8M9mLImbNVSQ4XNnKychqEJQFdDo42KM+8DR/45scx0sE+LjvLYulCx1zckqvcKD/pNB3qin9QePV8U+UjNDfCwYaYVEnSFS6dpQ==',key_name='tempest-keypair-996504905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-w08f5a2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=7146dad8-b7e6-4d2f-9774-148d3ddda54e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:68:a0,bridge_name='br-int',has_traffic_filtering=True,id=02c962b1-cd04-4515-9995-ede3554c6f07,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c962b1-cd') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'pci_devices' on Instance uuid 7146dad8-b7e6-4d2f-9774-148d3ddda54e {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:32:59 user nova-compute[74131]:   <uuid>7146dad8-b7e6-4d2f-9774-148d3ddda54e</uuid>
Oct 20 16:32:59 user nova-compute[74131]:   <name>instance-0000001d</name>
Oct 20 16:32:59 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:32:59 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:32:59 user nova-compute[74131]:   <metadata>
Oct 20 16:32:59 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:32:59 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:32:59 user nova-compute[74131]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1931189949</nova:name>
Oct 20 16:32:59 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:32:57</nova:creationTime>
Oct 20 16:32:59 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:32:59 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:32:59 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:32:59 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:32:59 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:32:59 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:32:59 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:32:59 user nova-compute[74131]:       <nova:owner>
Oct 20 16:32:59 user nova-compute[74131]:         <nova:user uuid="6c0f3a5e9862491897ec87644c577ebf">tempest-TestVolumeBootPattern-978997028-project-member</nova:user>
Oct 20 16:32:59 user nova-compute[74131]:         <nova:project uuid="a08267e8d79941d3a555dc3a51c58985">tempest-TestVolumeBootPattern-978997028</nova:project>
Oct 20 16:32:59 user nova-compute[74131]:       </nova:owner>
Oct 20 16:32:59 user nova-compute[74131]:       <nova:ports>
Oct 20 16:32:59 user nova-compute[74131]:         <nova:port uuid="02c962b1-cd04-4515-9995-ede3554c6f07">
Oct 20 16:32:59 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:32:59 user nova-compute[74131]:         </nova:port>
Oct 20 16:32:59 user nova-compute[74131]:       </nova:ports>
Oct 20 16:32:59 user nova-compute[74131]:     </nova:instance>
Oct 20 16:32:59 user nova-compute[74131]:   </metadata>
Oct 20 16:32:59 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:32:59 user nova-compute[74131]:     <system>
Oct 20 16:32:59 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:32:59 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:32:59 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:32:59 user nova-compute[74131]:       <entry name="serial">7146dad8-b7e6-4d2f-9774-148d3ddda54e</entry>
Oct 20 16:32:59 user nova-compute[74131]:       <entry name="uuid">7146dad8-b7e6-4d2f-9774-148d3ddda54e</entry>
Oct 20 16:32:59 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:32:59 user nova-compute[74131]:     </system>
Oct 20 16:32:59 user nova-compute[74131]:   </sysinfo>
Oct 20 16:32:59 user nova-compute[74131]:   <os>
Oct 20 16:32:59 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:32:59 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:32:59 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:32:59 user nova-compute[74131]:   </os>
Oct 20 16:32:59 user nova-compute[74131]:   <features>
Oct 20 16:32:59 user nova-compute[74131]:     <acpi/>
Oct 20 16:32:59 user nova-compute[74131]:     <apic/>
Oct 20 16:32:59 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:32:59 user nova-compute[74131]:   </features>
Oct 20 16:32:59 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:32:59 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:32:59 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:32:59 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:32:59 user nova-compute[74131]:   </clock>
Oct 20 16:32:59 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:32:59 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:32:59 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:32:59 user nova-compute[74131]:   </cpu>
Oct 20 16:32:59 user nova-compute[74131]:   <devices>
Oct 20 16:32:59 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:32:59 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:32:59 user nova-compute[74131]:       <source dev="/dev/sdd"/>
Oct 20 16:32:59 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:32:59 user nova-compute[74131]:       <serial>84a36ee8-2b74-44d4-9096-f43fa2aa6070</serial>
Oct 20 16:32:59 user nova-compute[74131]:     </disk>
Oct 20 16:32:59 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:32:59 user nova-compute[74131]:       <mac address="fa:16:3e:7d:68:a0"/>
Oct 20 16:32:59 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:32:59 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:32:59 user nova-compute[74131]:       <target dev="tap02c962b1-cd"/>
Oct 20 16:32:59 user nova-compute[74131]:     </interface>
Oct 20 16:32:59 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:32:59 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/7146dad8-b7e6-4d2f-9774-148d3ddda54e/console.log" append="off"/>
Oct 20 16:32:59 user nova-compute[74131]:     </serial>
Oct 20 16:32:59 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:32:59 user nova-compute[74131]:     <video>
Oct 20 16:32:59 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:32:59 user nova-compute[74131]:     </video>
Oct 20 16:32:59 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:32:59 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:32:59 user nova-compute[74131]:     </rng>
Oct 20 16:32:59 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:32:59 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:32:59 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:32:59 user nova-compute[74131]:     </memballoon>
Oct 20 16:32:59 user nova-compute[74131]:   </devices>
Oct 20 16:32:59 user nova-compute[74131]: </domain>
Oct 20 16:32:59 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1931189949',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1931189949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1931189949',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7FU1yXKJDnPDiSPVp1byP7mCUYNa8M9mLImbNVSQ4XNnKychqEJQFdDo42KM+8DR/45scx0sE+LjvLYulCx1zckqvcKD/pNB3qin9QePV8U+UjNDfCwYaYVEnSFS6dpQ==',key_name='tempest-keypair-996504905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-w08f5a2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=7146dad8-b7e6-4d2f-9774-148d3ddda54e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:68:a0,bridge_name='br-int',has_traffic_filtering=True,id=02c962b1-cd04-4515-9995-ede3554c6f07,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c962b1-cd') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG os_vif [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:68:a0,bridge_name='br-int',has_traffic_filtering=True,id=02c962b1-cd04-4515-9995-ede3554c6f07,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c962b1-cd') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a56f710-d037-5030-b97e-6d442f5e8827', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:59 user nova-compute[74131]: INFO nova.compute.manager [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Shelve offloading
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02c962b1-cd, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02c962b1-cd, col_values=(('qos', UUID('86bd0aa1-8b7f-4f96-a140-d6ef9032792c')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02c962b1-cd, col_values=(('external_ids', {'iface-id': '02c962b1-cd04-4515-9995-ede3554c6f07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:68:a0', 'vm-uuid': '7146dad8-b7e6-4d2f-9774-148d3ddda54e'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: INFO os_vif [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:68:a0,bridge_name='br-int',has_traffic_filtering=True,id=02c962b1-cd04-4515-9995-ede3554c6f07,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c962b1-cd')
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No VIF found with MAC fa:16:3e:7d:68:a0, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:59 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Took 0.84 seconds to deallocate network for instance.
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.network.neutron [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updated VIF entry in instance network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.network.neutron [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-51b0da52-584f-4221-8800-b745a13dd9af req-96eade58-64fb-4851-9271-9f1ce31916f1 service nova] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-320585e1-5fff-4b5d-937a-7f5af7aba1d6 req-2340492c-5a66-4d9c-b53f-9d161e447ba7 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-unplugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-320585e1-5fff-4b5d-937a-7f5af7aba1d6 req-2340492c-5a66-4d9c-b53f-9d161e447ba7 service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-320585e1-5fff-4b5d-937a-7f5af7aba1d6 req-2340492c-5a66-4d9c-b53f-9d161e447ba7 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-320585e1-5fff-4b5d-937a-7f5af7aba1d6 req-2340492c-5a66-4d9c-b53f-9d161e447ba7 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-320585e1-5fff-4b5d-937a-7f5af7aba1d6 req-2340492c-5a66-4d9c-b53f-9d161e447ba7 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-unplugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:59 user nova-compute[74131]: WARNING nova.compute.manager [req-320585e1-5fff-4b5d-937a-7f5af7aba1d6 req-2340492c-5a66-4d9c-b53f-9d161e447ba7 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received unexpected event network-vif-unplugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with vm_state active and task_state shelving.
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-a708df63-b1d6-42a0-9ce5-6ab964d14206 req-5ed512db-2a9d-4a1f-a5af-b016529ad07d service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a708df63-b1d6-42a0-9ce5-6ab964d14206 req-5ed512db-2a9d-4a1f-a5af-b016529ad07d service nova] Acquiring lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a708df63-b1d6-42a0-9ce5-6ab964d14206 req-5ed512db-2a9d-4a1f-a5af-b016529ad07d service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a708df63-b1d6-42a0-9ce5-6ab964d14206 req-5ed512db-2a9d-4a1f-a5af-b016529ad07d service nova] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-a708df63-b1d6-42a0-9ce5-6ab964d14206 req-5ed512db-2a9d-4a1f-a5af-b016529ad07d service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] No waiting events found dispatching network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:32:59 user nova-compute[74131]: WARNING nova.compute.manager [req-a708df63-b1d6-42a0-9ce5-6ab964d14206 req-5ed512db-2a9d-4a1f-a5af-b016529ad07d service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received unexpected event network-vif-plugged-6b904706-24ea-4eb8-93d6-577ddeaef64b for instance with vm_state deleted and task_state None.
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-a708df63-b1d6-42a0-9ce5-6ab964d14206 req-5ed512db-2a9d-4a1f-a5af-b016529ad07d service nova] [instance: 52b4f002-76fb-45c7-8b60-25c56d40740c] Received event network-vif-deleted-6b904706-24ea-4eb8-93d6-577ddeaef64b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:32:59 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Deleted allocations for instance 52b4f002-76fb-45c7-8b60-25c56d40740c
Oct 20 16:32:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29527c01-c480-4e5e-88de-83d60dccecc9 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "52b4f002-76fb-45c7-8b60-25c56d40740c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.650s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:00 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance destroyed successfully.
Oct 20 16:33:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG nova.network.neutron [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG nova.network.neutron [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-514612d8-de70-4de1-bd0f-58d10ec70dff req-21e2503a-d828-4afb-a0d3-5ac2cee22f70 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-514612d8-de70-4de1-bd0f-58d10ec70dff req-21e2503a-d828-4afb-a0d3-5ac2cee22f70 service nova] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-514612d8-de70-4de1-bd0f-58d10ec70dff req-21e2503a-d828-4afb-a0d3-5ac2cee22f70 service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-514612d8-de70-4de1-bd0f-58d10ec70dff req-21e2503a-d828-4afb-a0d3-5ac2cee22f70 service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-514612d8-de70-4de1-bd0f-58d10ec70dff req-21e2503a-d828-4afb-a0d3-5ac2cee22f70 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] No waiting events found dispatching network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:01 user nova-compute[74131]: WARNING nova.compute.manager [req-514612d8-de70-4de1-bd0f-58d10ec70dff req-21e2503a-d828-4afb-a0d3-5ac2cee22f70 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received unexpected event network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 for instance with vm_state building and task_state spawning.
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7f4a5504-b472-4dbd-ad7b-74d039e0e3e1 req-885f2aa3-ac00-4a3a-ab5b-6c1f19190d0f service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7f4a5504-b472-4dbd-ad7b-74d039e0e3e1 req-885f2aa3-ac00-4a3a-ab5b-6c1f19190d0f service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7f4a5504-b472-4dbd-ad7b-74d039e0e3e1 req-885f2aa3-ac00-4a3a-ab5b-6c1f19190d0f service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7f4a5504-b472-4dbd-ad7b-74d039e0e3e1 req-885f2aa3-ac00-4a3a-ab5b-6c1f19190d0f service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-7f4a5504-b472-4dbd-ad7b-74d039e0e3e1 req-885f2aa3-ac00-4a3a-ab5b-6c1f19190d0f service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:01 user nova-compute[74131]: WARNING nova.compute.manager [req-7f4a5504-b472-4dbd-ad7b-74d039e0e3e1 req-885f2aa3-ac00-4a3a-ab5b-6c1f19190d0f service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received unexpected event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with vm_state active and task_state shelving.
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance destroyed successfully.
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.objects.instance [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'resources' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1869711731',display_name='tempest-TestShelveInstance-server-1869711731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1869711731',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUJpKZ7EF3pMBcrZ8jN++RFwR8/CxEsDEstxbf+PP7z88HzQyANnHT228yzGCjshrKUPfLDZYwDuLx2aj5JTr07Q3kCISI9l9+7xCssaO1K13yoCfNczcpyUYs2bDCieg==',key_name='tempest-TestShelveInstance-1849926161',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92ce29bcf6e2431a92d345a3e739f81e',ramdisk_id='',reservation_id='r-t8xnfbd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1948790584',owner_user_name='tempest-TestShelveInstance-1948790584-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:31:56Z,user_data=None,user_id='059cd89b482d4205a8d7f5a32037afd9',uuid=2c80c4b9-4ab7-45e1-aca6-2bef81ffb635,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converting VIF {"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_vif [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddc3a20a-cb, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5be7dc1e-2555-4ab3-92e3-70a0c53f888c) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:01 user nova-compute[74131]: INFO os_vif [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb')
Oct 20 16:33:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:33:01 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc699ff-d093-4197-ad93-066e55790d9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:33:01 user nova-compute[74131]: No targets found.
Oct 20 16:33:01 user nova-compute[74131]: iSNS:
Oct 20 16:33:01 user nova-compute[74131]: No targets found.
Oct 20 16:33:01 user nova-compute[74131]: STATIC:
Oct 20 16:33:01 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01
Oct 20 16:33:01 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:01 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:01 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:33:01 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:01 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:01 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:33:01 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:01 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:01 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:33:01 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:01 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:01 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:33:01 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:01 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:01 user nova-compute[74131]: FIRMWARE:
Oct 20 16:33:01 user nova-compute[74131]: No targets found.
Oct 20 16:33:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:33:01 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:33:01 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[00502ec3-e6c2-48e9-a309-60fa9f4578c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dbdc81-06e6-4b06-b300-34713f7cb777]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c8717130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01'): ({'sdf'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Removing single pathed devices sdf {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62af7a4-fa59-4e4f-8c7c-84bf6e230627]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c616b1dd-360e-4433-86f3-411a03b2e738]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Flushing IO for device /dev/sdf {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e218f3b-7cce-41ed-8094-7453c032dfe4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:33:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6b52d4-ad4d-481b-b3aa-d1af5578052c]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761f18a-bace-450d-96bb-3fae8e4670f3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[760467f3-1d09-4b12-ac7f-09ffa5dcc452]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]
Oct 20 16:33:02 user nova-compute[74131]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.
Oct 20 16:33:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b2a0c-5eeb-4e9c-bde6-51ad860e6c94]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] <== disconnect_volume: return (314ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:33:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Deleting instance files /opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635_del
Oct 20 16:33:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Deletion of /opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635_del complete
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:33:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Instance spawned successfully.
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:03 user nova-compute[74131]: INFO nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-8331acfb-96de-4e13-92f0-23d75a204a94 req-22b88694-61a6-4296-91cb-53f6eeb09a1f service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8331acfb-96de-4e13-92f0-23d75a204a94 req-22b88694-61a6-4296-91cb-53f6eeb09a1f service nova] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8331acfb-96de-4e13-92f0-23d75a204a94 req-22b88694-61a6-4296-91cb-53f6eeb09a1f service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8331acfb-96de-4e13-92f0-23d75a204a94 req-22b88694-61a6-4296-91cb-53f6eeb09a1f service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-8331acfb-96de-4e13-92f0-23d75a204a94 req-22b88694-61a6-4296-91cb-53f6eeb09a1f service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] No waiting events found dispatching network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:03 user nova-compute[74131]: WARNING nova.compute.manager [req-8331acfb-96de-4e13-92f0-23d75a204a94 req-22b88694-61a6-4296-91cb-53f6eeb09a1f service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received unexpected event network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 for instance with vm_state building and task_state spawning.
Oct 20 16:33:03 user nova-compute[74131]: INFO nova.compute.manager [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Took 25.86 seconds to build instance.
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b28ef600-bca1-4244-9bf0-7087c712b4a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.976s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:03 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Deleted allocations for instance 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.objects.instance [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.objects.base [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Object Instance<2c80c4b9-4ab7-45e1-aca6-2bef81ffb635> lazy-loaded attributes: resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing instance network info cache due to event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG nova.network.neutron [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:33:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-292884b0-967e-4592-a60b-f879744fdf20 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.602s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updated VIF entry in instance network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:33:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": null, "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9d5f51e-5c16-44ad-b904-5ca216986d7a req-96c503ef-1596-4b58-a031-e80ee0f90468 service nova] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:13 user nova-compute[74131]: INFO nova.compute.manager [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Detaching volume ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:33:13 user nova-compute[74131]: INFO nova.virt.block_device [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Attempting to driver detach volume ce8bf45d-5541-4133-90dc-d3dfb176bcb2 from mountpoint /dev/vdb
Oct 20 16:33:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Attempting to detach device vdb from instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:33:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:33:13 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:13 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:33:13 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:13 user nova-compute[74131]:   <serial>ce8bf45d-5541-4133-90dc-d3dfb176bcb2</serial>
Oct 20 16:33:13 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:33:13 user nova-compute[74131]: </disk>
Oct 20 16:33:13 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:33:13 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Successfully detached device vdb from instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff from the persistent domain config.
Oct 20 16:33:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:33:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:33:13 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:13 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:33:13 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:13 user nova-compute[74131]:   <serial>ce8bf45d-5541-4133-90dc-d3dfb176bcb2</serial>
Oct 20 16:33:13 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:33:13 user nova-compute[74131]: </disk>
Oct 20 16:33:13 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:33:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:33:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-changed-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Refreshing instance network info cache due to event network-changed-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:33:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] Acquiring lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] Acquired lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:16 user nova-compute[74131]: DEBUG nova.network.neutron [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Refreshing network info cache for port 8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:33:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG nova.network.neutron [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updated VIF entry in instance network info cache for port 8f7d9300-b2cb-4eed-a1d4-48f9ecfce446. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG nova.network.neutron [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updating instance_info_cache with network_info: [{"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-95beec87-687c-405c-992d-2826a9489da8 req-7ffe7cdb-ffbc-432d-bb6c-f141b47e8a7d service nova] Releasing lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG nova.objects.instance [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'flavor' on Instance uuid a16108af-bab9-4146-a928-4b2191f6f458 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:17 user nova-compute[74131]: INFO nova.compute.manager [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Attaching volume 1031e8bf-dfb9-4032-aab3-d4fb24a4b314 to /dev/vdb
Oct 20 16:33:17 user nova-compute[74131]: DEBUG os_brick.utils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80ee7e4-e55a-47f1-8eb1-23b5f9d0ec0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8834d2-c635-4978-bdad-efb4f1d49c6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7fd6a1-34e8-4bf5-a5ff-81490f5f92e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee304b70-6e48-4502-81c1-6e8a21b5ff79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:33:17 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:33:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a8ba78-da76-4fdc-8d9f-c8df1ff89c12]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG os_brick.utils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:33:17 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updating existing volume attachment record: fa20a1d5-9484-4861-a1db-fd4b0e5be1a2 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:33:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-changed-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Refreshing instance network info cache due to event network-changed-dffa8252-791e-4011-aff0-2b2d2ca1c91b. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] Acquiring lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] Acquired lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Refreshing network info cache for port dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Updated VIF entry in instance network info cache for port dffa8252-791e-4011-aff0-2b2d2ca1c91b. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Updating instance_info_cache with network_info: [{"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8333bc0d-e998-4cb6-9cfc-3bc94f20b616 req-72d43850-6f84-4e73-aa19-6f35bcf153da service nova] Releasing lock "refresh_cache-81225581-aa2b-44dc-a7f0-70c94af0cff3" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:33:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:33:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 81225581-aa2b-44dc-a7f0-70c94af0cff3 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:30 user nova-compute[74131]: INFO nova.compute.manager [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Attaching volume 0e6b3090-eb06-423c-bf78-8ff783773c6c to /dev/vdb
Oct 20 16:33:30 user nova-compute[74131]: DEBUG os_brick.utils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe7299-92e3-4bf1-a20a-c289501cc9a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb09a89-7f13-4470-99a7-3d259f2983d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6541c834-72e8-4622-a763-2742a86b7a4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[42deecd4-d334-4034-9606-9453c3069087]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:33:30 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcb44a1-f061-4af7-b2dc-379f855bb11f]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG os_brick.utils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Updating existing volume attachment record: 60379403-55d5-4c4d-ae82-79a69aca39dd {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:31 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:33:31 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.079513549804688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 7146dad8-b7e6-4d2f-9774-148d3ddda54e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:33:31 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:33:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:33:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:33 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff is timed out.
Oct 20 16:33:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Successfully detached device vdb from instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff from the live domain config.
Oct 20 16:33:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOTFRESG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:33:33 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:33:33 user nova-compute[74131]: INFO nova.compute.manager [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Unrescuing
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG nova.network.neutron [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2a3536-655e-4cb4-a702-f12bcdead576]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:33:33 user nova-compute[74131]: No targets found.
Oct 20 16:33:33 user nova-compute[74131]: iSNS:
Oct 20 16:33:33 user nova-compute[74131]: No targets found.
Oct 20 16:33:33 user nova-compute[74131]: STATIC:
Oct 20 16:33:33 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2
Oct 20 16:33:33 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:33 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:33 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:33:33 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:33 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:33 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:33:33 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:33 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:33 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:33:33 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:33:33 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:33:33 user nova-compute[74131]: FIRMWARE:
Oct 20 16:33:33 user nova-compute[74131]: No targets found.
Oct 20 16:33:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:33:33 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:33:33 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6c510-336e-484e-b4a0-0b26e7c2c4f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3911b-95ba-4b6d-8f20-05bde5613d90]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:33 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:33:33 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:33 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:33 user nova-compute[74131]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 (non-flash)
Oct 20 16:33:33 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:33 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c82d5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2'): ({'sde'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Removing single pathed devices sde {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e87380-9e6b-4346-b248-868b8d33e119]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70ff226-71cf-4060-b60e-36d05a30a19b]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Flushing IO for device /dev/sde {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0a336d-58e2-49ef-a5e3-e0e04d6915a8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e0f30-4f31-4656-b99a-9527c538d68b]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f401486-fae7-4336-865c-abc24a88eb9b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6a7d5d-0228-4c95-a9a2-84d3ab5058ab]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260]
Oct 20 16:33:33 user nova-compute[74131]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2, portal: 172.16.0.220,3260] successful.
Oct 20 16:33:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8bf45d-5541-4133-90dc-d3dfb176bcb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f12b54-80b1-4981-8d24-bf5816d8a107]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] <== disconnect_volume: return (316ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:33:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating instance_info_cache with network_info: [{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG nova.objects.instance [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'flavor' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-f5cdbc90-b338-4d21-b9dc-39100636d64e req-931b12a4-1452-4c9f-b964-64514fc41b48 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f5cdbc90-b338-4d21-b9dc-39100636d64e req-931b12a4-1452-4c9f-b964-64514fc41b48 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f5cdbc90-b338-4d21-b9dc-39100636d64e req-931b12a4-1452-4c9f-b964-64514fc41b48 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f5cdbc90-b338-4d21-b9dc-39100636d64e req-931b12a4-1452-4c9f-b964-64514fc41b48 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-f5cdbc90-b338-4d21-b9dc-39100636d64e req-931b12a4-1452-4c9f-b964-64514fc41b48 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:34 user nova-compute[74131]: WARNING nova.compute.manager [req-f5cdbc90-b338-4d21-b9dc-39100636d64e req-931b12a4-1452-4c9f-b964-64514fc41b48 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:33:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance destroyed successfully.
Oct 20 16:33:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG nova.objects.instance [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'flavor' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-23f1a5a8-9881-4f95-9031-205b195642c4 tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.110s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPfuIaRN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:33:36 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:33:36 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:33:36 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89f81de-4f8a-4220-a384-add7ca83fc0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:33:36 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dda80d-a022-4e8c-b52d-214fd00b0791]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314] added
Oct 20 16:33:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35f422-8c84-4fc9-b356-8d767225eb3e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1380cca0-4cc5-4250-979b-821ba22e22f6]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPfuIaRN {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPfuIaRN" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[959fddaa-4557-45ff-a355-d6dead78715b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPfuIaRN'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf28cea-bb3f-425b-9fdc-5b5637ad9b2b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:36 user nova-compute[74131]: WARNING nova.compute.manager [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:33:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:36 user nova-compute[74131]: WARNING nova.compute.manager [req-0d356a13-99aa-430e-a485-bd3f4e906eb6 req-ae369f17-5817-42d8-9f4d-3679ae5e0974 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[866be4ba-c4ac-47d8-905f-049a72b61364]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125954e-b70c-42c0-9217-f5a4097e1618]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260]
Oct 20 16:33:36 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260] successful.
Oct 20 16:33:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c9b5a-60a7-490f-82fb-7df05725ccce]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2583dfec-6c83-41ac-bd47-6c95b765e176]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:33:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:36 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:33:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8166462-804a-472e-9b44-835732d12641]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:33:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:37 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:33:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPfuIaRN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:33:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:33:37 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23230336366346363', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:33:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230336366346363', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:33:37 user nova-compute[74131]: DEBUG nova.objects.instance [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'flavor' on Instance uuid a16108af-bab9-4146-a928-4b2191f6f458 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:33:37 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:37 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:33:37 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:37 user nova-compute[74131]:   <serial>1031e8bf-dfb9-4032-aab3-d4fb24a4b314</serial>
Oct 20 16:33:37 user nova-compute[74131]: </disk>
Oct 20 16:33:37 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No VIF found with MAC fa:16:3e:d2:b2:50, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45091f10-b830-4896-9358-54b7302231c5 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.863s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG nova.compute.manager [None req-51345402-3649-466a-8afd-1701ecd627f1 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-b22fc53f-25bd-4748-a0d7-9418fafb893d req-78ff025c-1cd9-4ac7-b523-01960e3491b3 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b22fc53f-25bd-4748-a0d7-9418fafb893d req-78ff025c-1cd9-4ac7-b523-01960e3491b3 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b22fc53f-25bd-4748-a0d7-9418fafb893d req-78ff025c-1cd9-4ac7-b523-01960e3491b3 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b22fc53f-25bd-4748-a0d7-9418fafb893d req-78ff025c-1cd9-4ac7-b523-01960e3491b3 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-b22fc53f-25bd-4748-a0d7-9418fafb893d req-78ff025c-1cd9-4ac7-b523-01960e3491b3 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:38 user nova-compute[74131]: WARNING nova.compute.manager [req-b22fc53f-25bd-4748-a0d7-9418fafb893d req-78ff025c-1cd9-4ac7-b523-01960e3491b3 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state active and task_state None.
Oct 20 16:33:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:40 user nova-compute[74131]: INFO nova.compute.manager [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Detaching volume 1031e8bf-dfb9-4032-aab3-d4fb24a4b314
Oct 20 16:33:40 user nova-compute[74131]: INFO nova.virt.block_device [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Attempting to driver detach volume 1031e8bf-dfb9-4032-aab3-d4fb24a4b314 from mountpoint /dev/vdb
Oct 20 16:33:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Attempting to detach device vdb from instance a16108af-bab9-4146-a928-4b2191f6f458 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:33:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:33:40 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:40 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:33:40 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:40 user nova-compute[74131]:   <serial>1031e8bf-dfb9-4032-aab3-d4fb24a4b314</serial>
Oct 20 16:33:40 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:33:40 user nova-compute[74131]: </disk>
Oct 20 16:33:40 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:33:40 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully detached device vdb from instance a16108af-bab9-4146-a928-4b2191f6f458 from the persistent domain config.
Oct 20 16:33:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a16108af-bab9-4146-a928-4b2191f6f458 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:33:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:33:40 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:40 user nova-compute[74131]:   <source dev="/dev/sde"/>
Oct 20 16:33:40 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:40 user nova-compute[74131]:   <serial>1031e8bf-dfb9-4032-aab3-d4fb24a4b314</serial>
Oct 20 16:33:40 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:33:40 user nova-compute[74131]: </disk>
Oct 20 16:33:40 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:33:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a16108af-bab9-4146-a928-4b2191f6f458 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:33:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrxsAmib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:33:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:33:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:33:48 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcccb11-b011-40c9-add2-3f995882d1b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:33:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb073fb-44b8-47a5-be95-c2243bdea395]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c] added
Oct 20 16:33:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd30b3e1-b135-4f3b-8483-38e83da6db6c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[47480f3a-57ce-42ab-934e-7d72b7350ee2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrxsAmib {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrxsAmib" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b50d76-8b9b-4cff-b23f-1a18742497bf]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lrxsAmib'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ccfedc-5c99-4e89-bd48-6070a217a94c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eab299-5acd-4d45-b3d9-e1458e8021c2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bfd9e5-4295-404d-ad4e-40999af16afc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260]
Oct 20 16:33:48 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260] successful.
Oct 20 16:33:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8265c-acab-49fa-982a-4c8b6dd5c8f7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa4a99-4b01-4eda-9c2f-28560ae7d3ff]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)
Oct 20 16:33:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:33:48 user nova-compute[74131]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)
Oct 20 16:33:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef81cc-6ba8-4dbb-abdc-0ec41adfbc86]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:33:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:33:49 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:33:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrxsAmib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:33:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:33:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26564313934613865', 'path': '/dev/sdf'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:33:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564313934613865', 'path': '/dev/sdf'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:33:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 81225581-aa2b-44dc-a7f0-70c94af0cff3 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:33:49 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:49 user nova-compute[74131]:   <source dev="/dev/sdf"/>
Oct 20 16:33:49 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:49 user nova-compute[74131]:   <serial>0e6b3090-eb06-423c-bf78-8ff783773c6c</serial>
Oct 20 16:33:49 user nova-compute[74131]: </disk>
Oct 20 16:33:49 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:33:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:33:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:33:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] No VIF found with MAC fa:16:3e:cd:73:e2, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:33:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543cf36-6f02-4bab-9e92-3b413e3fd6dd tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.013s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:33:51 user nova-compute[74131]: INFO nova.compute.claims [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Claim successful on node user
Oct 20 16:33:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:51 user nova-compute[74131]: INFO nova.compute.manager [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Detaching volume 0e6b3090-eb06-423c-bf78-8ff783773c6c
Oct 20 16:33:51 user nova-compute[74131]: INFO nova.virt.block_device [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Attempting to driver detach volume 0e6b3090-eb06-423c-bf78-8ff783773c6c from mountpoint /dev/vdb
Oct 20 16:33:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Attempting to detach device vdb from instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:33:51 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:51 user nova-compute[74131]:   <source dev="/dev/sdf"/>
Oct 20 16:33:51 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:51 user nova-compute[74131]:   <serial>0e6b3090-eb06-423c-bf78-8ff783773c6c</serial>
Oct 20 16:33:51 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:33:51 user nova-compute[74131]: </disk>
Oct 20 16:33:51 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:33:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully detached device vdb from instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 from the persistent domain config.
Oct 20 16:33:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:33:51 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:33:51 user nova-compute[74131]:   <source dev="/dev/sdf"/>
Oct 20 16:33:51 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:33:51 user nova-compute[74131]:   <serial>0e6b3090-eb06-423c-bf78-8ff783773c6c</serial>
Oct 20 16:33:51 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:33:51 user nova-compute[74131]: </disk>
Oct 20 16:33:51 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:51 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:33:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.policy [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501cfb16d7aa4ef78ea393a53b7aa555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e81e0cc8c84c22bcb419d79a119364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:33:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Creating image(s)
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:52 user nova-compute[74131]: INFO nova.compute.manager [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Terminating instance
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk 1073741824" returned: 0 in 0.072s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.248s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-75e02000-9124-47fc-b4dd-c53ec1897363 req-3a7d1518-d30b-4215-9a97-7f3d8a57ef62 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-vif-unplugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75e02000-9124-47fc-b4dd-c53ec1897363 req-3a7d1518-d30b-4215-9a97-7f3d8a57ef62 service nova] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75e02000-9124-47fc-b4dd-c53ec1897363 req-3a7d1518-d30b-4215-9a97-7f3d8a57ef62 service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75e02000-9124-47fc-b4dd-c53ec1897363 req-3a7d1518-d30b-4215-9a97-7f3d8a57ef62 service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-75e02000-9124-47fc-b4dd-c53ec1897363 req-3a7d1518-d30b-4215-9a97-7f3d8a57ef62 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] No waiting events found dispatching network-vif-unplugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.compute.manager [req-75e02000-9124-47fc-b4dd-c53ec1897363 req-3a7d1518-d30b-4215-9a97-7f3d8a57ef62 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-vif-unplugged-63aa31e1-90f1-4666-8afa-aa2333595208 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Successfully created port: a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Cannot resize image /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Ensure instance console log exists: /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Instance destroyed successfully.
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.objects.instance [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lazy-loading 'resources' on Instance uuid 5e111d85-bd8d-40b4-b664-8ab924063cb6 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1824514671',display_name='tempest-VolumesAdminNegativeTest-server-1824514671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1824514671',id=21,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKd3Ykv1OyUkCOokuVnAflB+CLmZ+tO3CxGHUEShH0odlbivMQR9avsmoQnysyZk3HXIYWN+6jBgGamj5vr5AAXZsUdkx7PzIJGVNEz+jz7jrWSbi5c70ZOTfC+S4i1Sg==',key_name='tempest-keypair-2091384900',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:27:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dfddd1bd2cd4dde9c2fede4e4d6aa00',ramdisk_id='',reservation_id='r-cl3bouv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-651596449',owner_user_name='tempest-VolumesAdminNegativeTest-651596449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:27:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27db8d4c54ec453b95a9a0de35d18fe3',uuid=5e111d85-bd8d-40b4-b664-8ab924063cb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converting VIF {"id": "63aa31e1-90f1-4666-8afa-aa2333595208", "address": "fa:16:3e:5f:ff:b0", "network": {"id": "60d6946c-7e7b-4077-9bbc-d26421854f8a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2081657277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfddd1bd2cd4dde9c2fede4e4d6aa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63aa31e1-90", "ovs_interfaceid": "63aa31e1-90f1-4666-8afa-aa2333595208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ff:b0,bridge_name='br-int',has_traffic_filtering=True,id=63aa31e1-90f1-4666-8afa-aa2333595208,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63aa31e1-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG os_vif [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ff:b0,bridge_name='br-int',has_traffic_filtering=True,id=63aa31e1-90f1-4666-8afa-aa2333595208,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63aa31e1-90') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63aa31e1-90, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57c8dd0a-eb2e-4f89-aab6-d51e1858ba85) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:33:53 user nova-compute[74131]: INFO os_vif [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ff:b0,bridge_name='br-int',has_traffic_filtering=True,id=63aa31e1-90f1-4666-8afa-aa2333595208,network=Network(60d6946c-7e7b-4077-9bbc-d26421854f8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63aa31e1-90')
Oct 20 16:33:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Deleting instance files /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6_del
Oct 20 16:33:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Deletion of /opt/stack/data/nova/instances/5e111d85-bd8d-40b4-b664-8ab924063cb6_del complete
Oct 20 16:33:53 user nova-compute[74131]: INFO nova.compute.manager [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 16:33:53 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:33:53 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Successfully updated port: a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquired lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Releasing lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance network_info: |[{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Start _get_guest_xml network_info=[{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:33:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:33:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949739455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949739455',id=30,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ZqviLSokViG2Q1GMcg2v0NA1/0InAjTVojMUxsKDqWU2ZFjY5eQaj/XwReZeMLvlcK3up1KwckNZkxN9ZHxwPiScuEKI1kfjb66N+FAbroZx55XGQ8tn2qE1a/rx6GA==',key_name='tempest-keypair-2111111205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-95zxp0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=e30f3de0-f564-4c73-9d9f-7292ceab83b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.objects.instance [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'pci_devices' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:33:54 user nova-compute[74131]:   <uuid>e30f3de0-f564-4c73-9d9f-7292ceab83b1</uuid>
Oct 20 16:33:54 user nova-compute[74131]:   <name>instance-0000001e</name>
Oct 20 16:33:54 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:33:54 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:33:54 user nova-compute[74131]:   <metadata>
Oct 20 16:33:54 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:33:54 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:33:54 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1949739455</nova:name>
Oct 20 16:33:54 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:33:54</nova:creationTime>
Oct 20 16:33:54 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:33:54 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:33:54 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:33:54 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:33:54 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:33:54 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:33:54 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:33:54 user nova-compute[74131]:       <nova:owner>
Oct 20 16:33:54 user nova-compute[74131]:         <nova:user uuid="501cfb16d7aa4ef78ea393a53b7aa555">tempest-AttachVolumeShelveTestJSON-189572795-project-member</nova:user>
Oct 20 16:33:54 user nova-compute[74131]:         <nova:project uuid="02e81e0cc8c84c22bcb419d79a119364">tempest-AttachVolumeShelveTestJSON-189572795</nova:project>
Oct 20 16:33:54 user nova-compute[74131]:       </nova:owner>
Oct 20 16:33:54 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:33:54 user nova-compute[74131]:       <nova:ports>
Oct 20 16:33:54 user nova-compute[74131]:         <nova:port uuid="a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee">
Oct 20 16:33:54 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 16:33:54 user nova-compute[74131]:         </nova:port>
Oct 20 16:33:54 user nova-compute[74131]:       </nova:ports>
Oct 20 16:33:54 user nova-compute[74131]:     </nova:instance>
Oct 20 16:33:54 user nova-compute[74131]:   </metadata>
Oct 20 16:33:54 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:33:54 user nova-compute[74131]:     <system>
Oct 20 16:33:54 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:33:54 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:33:54 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:33:54 user nova-compute[74131]:       <entry name="serial">e30f3de0-f564-4c73-9d9f-7292ceab83b1</entry>
Oct 20 16:33:54 user nova-compute[74131]:       <entry name="uuid">e30f3de0-f564-4c73-9d9f-7292ceab83b1</entry>
Oct 20 16:33:54 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:33:54 user nova-compute[74131]:     </system>
Oct 20 16:33:54 user nova-compute[74131]:   </sysinfo>
Oct 20 16:33:54 user nova-compute[74131]:   <os>
Oct 20 16:33:54 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:33:54 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:33:54 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:33:54 user nova-compute[74131]:   </os>
Oct 20 16:33:54 user nova-compute[74131]:   <features>
Oct 20 16:33:54 user nova-compute[74131]:     <acpi/>
Oct 20 16:33:54 user nova-compute[74131]:     <apic/>
Oct 20 16:33:54 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:33:54 user nova-compute[74131]:   </features>
Oct 20 16:33:54 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:33:54 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:33:54 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:33:54 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:33:54 user nova-compute[74131]:   </clock>
Oct 20 16:33:54 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:33:54 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:33:54 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:33:54 user nova-compute[74131]:   </cpu>
Oct 20 16:33:54 user nova-compute[74131]:   <devices>
Oct 20 16:33:54 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:33:54 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:33:54 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk"/>
Oct 20 16:33:54 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:33:54 user nova-compute[74131]:     </disk>
Oct 20 16:33:54 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:33:54 user nova-compute[74131]:       <mac address="fa:16:3e:9c:93:f1"/>
Oct 20 16:33:54 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:33:54 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:33:54 user nova-compute[74131]:       <target dev="tapa7757fa8-59"/>
Oct 20 16:33:54 user nova-compute[74131]:     </interface>
Oct 20 16:33:54 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:33:54 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/console.log" append="off"/>
Oct 20 16:33:54 user nova-compute[74131]:     </serial>
Oct 20 16:33:54 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:33:54 user nova-compute[74131]:     <video>
Oct 20 16:33:54 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:33:54 user nova-compute[74131]:     </video>
Oct 20 16:33:54 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:33:54 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:33:54 user nova-compute[74131]:     </rng>
Oct 20 16:33:54 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:33:54 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:33:54 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:33:54 user nova-compute[74131]:     </memballoon>
Oct 20 16:33:54 user nova-compute[74131]:   </devices>
Oct 20 16:33:54 user nova-compute[74131]: </domain>
Oct 20 16:33:54 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949739455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949739455',id=30,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ZqviLSokViG2Q1GMcg2v0NA1/0InAjTVojMUxsKDqWU2ZFjY5eQaj/XwReZeMLvlcK3up1KwckNZkxN9ZHxwPiScuEKI1kfjb66N+FAbroZx55XGQ8tn2qE1a/rx6GA==',key_name='tempest-keypair-2111111205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-95zxp0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=e30f3de0-f564-4c73-9d9f-7292ceab83b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG os_vif [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8321c0d-67f9-5d26-8783-3ad524d36c47', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7757fa8-59, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7757fa8-59, col_values=(('qos', UUID('0ff2d666-ba80-4298-bdb2-b1811e8e9658')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7757fa8-59, col_values=(('external_ids', {'iface-id': 'a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:93:f1', 'vm-uuid': 'e30f3de0-f564-4c73-9d9f-7292ceab83b1'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:54 user nova-compute[74131]: INFO os_vif [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59')
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No VIF found with MAC fa:16:3e:9c:93:f1, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:54 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Took 0.97 seconds to deallocate network for instance.
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-acc633d8-c145-4d5c-8d81-4c03d4b48c72 req-d9558bd6-b34b-4194-aed8-05f77e3db607 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-vif-deleted-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:54 user nova-compute[74131]: INFO nova.compute.manager [req-acc633d8-c145-4d5c-8d81-4c03d4b48c72 req-d9558bd6-b34b-4194-aed8-05f77e3db607 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Neutron deleted interface 63aa31e1-90f1-4666-8afa-aa2333595208; detaching it from the instance and deleting it from the info cache
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-acc633d8-c145-4d5c-8d81-4c03d4b48c72 req-d9558bd6-b34b-4194-aed8-05f77e3db607 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-acc633d8-c145-4d5c-8d81-4c03d4b48c72 req-d9558bd6-b34b-4194-aed8-05f77e3db607 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Detach interface failed, port_id=63aa31e1-90f1-4666-8afa-aa2333595208, reason: Instance 5e111d85-bd8d-40b4-b664-8ab924063cb6 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received event network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] Acquiring lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] No waiting events found dispatching network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:55 user nova-compute[74131]: WARNING nova.compute.manager [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: 5e111d85-bd8d-40b4-b664-8ab924063cb6] Received unexpected event network-vif-plugged-63aa31e1-90f1-4666-8afa-aa2333595208 for instance with vm_state deleted and task_state None.
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing instance network info cache due to event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] Acquiring lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] Acquired lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:33:55 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Deleted allocations for instance 5e111d85-bd8d-40b4-b664-8ab924063cb6
Oct 20 16:33:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-249be311-e529-4fba-8852-82e7ac8020b5 tempest-VolumesAdminNegativeTest-651596449 tempest-VolumesAdminNegativeTest-651596449-project-member] Lock "5e111d85-bd8d-40b4-b664-8ab924063cb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updated VIF entry in instance network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:33:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1cabcb66-5590-41fd-a763-f65d651c858d req-f13db26b-7e89-43cd-86ae-f6d33585bf95 service nova] Releasing lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:56 user nova-compute[74131]: WARNING nova.compute.manager [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received unexpected event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with vm_state building and task_state spawning.
Oct 20 16:33:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:33:56 user nova-compute[74131]: WARNING nova.compute.manager [req-211fbe6c-7fc6-46a8-9051-e5c33ebd4a9b req-d2952c2b-717d-4819-8e7c-10c319f9b4d4 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received unexpected event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with vm_state building and task_state spawning.
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:33:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance spawned successfully.
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:33:58 user nova-compute[74131]: INFO nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 20 16:33:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:33:58 user nova-compute[74131]: INFO nova.compute.manager [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Took 6.91 seconds to build instance.
Oct 20 16:33:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8577c2b9-c707-4ae1-b160-f236d5e9dd38 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.043s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:33:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:00 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a16108af-bab9-4146-a928-4b2191f6f458 is timed out.
Oct 20 16:34:00 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully detached device vdb from instance a16108af-bab9-4146-a928-4b2191f6f458 from the live domain config.
Oct 20 16:34:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPfuIaRN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:34:00 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:34:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb838f-fd9a-4ab8-8abc-e20d8eb4c0c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:34:00 user nova-compute[74131]: No targets found.
Oct 20 16:34:00 user nova-compute[74131]: iSNS:
Oct 20 16:34:00 user nova-compute[74131]: No targets found.
Oct 20 16:34:00 user nova-compute[74131]: STATIC:
Oct 20 16:34:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c
Oct 20 16:34:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314
Oct 20 16:34:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:34:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:34:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:00 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:34:00 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:00 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:00 user nova-compute[74131]: FIRMWARE:
Oct 20 16:34:00 user nova-compute[74131]: No targets found.
Oct 20 16:34:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:34:00 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:34:00 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c9c526-4f18-4d23-b41b-d9859645c386]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f0feaf-f1ce-4813-ab1d-cee378a4cde9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)
Oct 20 16:34:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 (non-flash)
Oct 20 16:34:01 user nova-compute[74131]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)
Oct 20 16:34:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e015a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314'): ({'sde'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Removing single pathed devices sde {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf675f8-2ee3-4d5f-a9b1-f7826feea011]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef9bf1f-fa7b-43ed-858c-26411cba571b]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Flushing IO for device /dev/sde {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a8c745-c166-4430-9489-72d92c119432]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7028ef9f-70d7-4b98-9832-916f2e114c89]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e447dcc-6c7e-4e38-b262-e087d5d4aca7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06eb6dc-d56d-42a1-834e-ac4dc078fba8]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260]
Oct 20 16:34:01 user nova-compute[74131]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314, portal: 172.16.0.220,3260] successful.
Oct 20 16:34:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1031e8bf-dfb9-4032-aab3-d4fb24a4b314 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2808278-4c29-4942-a362-3c923951d497]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] <== disconnect_volume: return (318ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:34:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:34:02 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'flavor' on Instance uuid a16108af-bab9-4146-a928-4b2191f6f458 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:34:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f7a17baf-050c-4a10-a457-ca8aa7a28fec tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.758s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:03 user nova-compute[74131]: INFO nova.compute.manager [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Terminating instance
Oct 20 16:34:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-e951abb2-6b42-4dd9-925a-fdcfba4be3f4 req-f5e4aace-58ba-437b-aa80-132e8c441a1b service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e951abb2-6b42-4dd9-925a-fdcfba4be3f4 req-f5e4aace-58ba-437b-aa80-132e8c441a1b service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e951abb2-6b42-4dd9-925a-fdcfba4be3f4 req-f5e4aace-58ba-437b-aa80-132e8c441a1b service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e951abb2-6b42-4dd9-925a-fdcfba4be3f4 req-f5e4aace-58ba-437b-aa80-132e8c441a1b service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-e951abb2-6b42-4dd9-925a-fdcfba4be3f4 req-f5e4aace-58ba-437b-aa80-132e8c441a1b service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-e951abb2-6b42-4dd9-925a-fdcfba4be3f4 req-f5e4aace-58ba-437b-aa80-132e8c441a1b service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-unplugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Instance destroyed successfully.
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lazy-loading 'resources' on Instance uuid 9ff2e5d8-f854-4f8b-941f-17ba5e47caff {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-447823817',display_name='tempest-ServerStableDeviceRescueTest-server-447823817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-447823817',id=17,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFncVUjULMjWlv7/khPkG+gUk9kJKtqLh6194ST9QWIhoqdt30J9vNE2m2+X8p5mbqpA2A0wOS2CLlIf6kljzOofXEo0C8y6Vx/aPVzgsfijCalCmczjb5nqXPiG4INkw==',key_name='tempest-keypair-392604751',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:30:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff11d09248b04962964ad7f47275a2d5',ramdisk_id='',reservation_id='r-vpxn1dqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-472624141',owner_user_name='tempest-ServerStableDeviceRescueTest-472624141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a97cc9f5e947c19c91e9f39a3ff550',uuid=9ff2e5d8-f854-4f8b-941f-17ba5e47caff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converting VIF {"id": "3058f4d2-f621-46ec-b677-b5161dba512f", "address": "fa:16:3e:97:63:35", "network": {"id": "fd571618-85ac-43fa-83fe-b5a74cc3f177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1102251200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff11d09248b04962964ad7f47275a2d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3058f4d2-f6", "ovs_interfaceid": "3058f4d2-f621-46ec-b677-b5161dba512f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG os_vif [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3058f4d2-f6, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=feb0487e-c956-4afa-9337-901668f72f1f) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:04 user nova-compute[74131]: INFO os_vif [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:63:35,bridge_name='br-int',has_traffic_filtering=True,id=3058f4d2-f621-46ec-b677-b5161dba512f,network=Network(fd571618-85ac-43fa-83fe-b5a74cc3f177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3058f4d2-f6')
Oct 20 16:34:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Deleting instance files /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff_del
Oct 20 16:34:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Deletion of /opt/stack/data/nova/instances/9ff2e5d8-f854-4f8b-941f-17ba5e47caff_del complete
Oct 20 16:34:04 user nova-compute[74131]: INFO nova.compute.manager [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 16:34:04 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:34:04 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:34:05 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:05 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Took 0.74 seconds to deallocate network for instance.
Oct 20 16:34:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:05 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:34:05 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:34:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:05 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Deleted allocations for instance 9ff2e5d8-f854-4f8b-941f-17ba5e47caff
Oct 20 16:34:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a67160ce-34be-4dda-8a30-6fc6080d301c tempest-ServerStableDeviceRescueTest-472624141 tempest-ServerStableDeviceRescueTest-472624141-project-member] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-8e2463b5-c091-426b-80f8-1997b73b800c req-bb4aa9c9-54d6-4a31-8ca1-f0b701d6e765 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8e2463b5-c091-426b-80f8-1997b73b800c req-bb4aa9c9-54d6-4a31-8ca1-f0b701d6e765 service nova] Acquiring lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8e2463b5-c091-426b-80f8-1997b73b800c req-bb4aa9c9-54d6-4a31-8ca1-f0b701d6e765 service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8e2463b5-c091-426b-80f8-1997b73b800c req-bb4aa9c9-54d6-4a31-8ca1-f0b701d6e765 service nova] Lock "9ff2e5d8-f854-4f8b-941f-17ba5e47caff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-8e2463b5-c091-426b-80f8-1997b73b800c req-bb4aa9c9-54d6-4a31-8ca1-f0b701d6e765 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] No waiting events found dispatching network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:34:06 user nova-compute[74131]: WARNING nova.compute.manager [req-8e2463b5-c091-426b-80f8-1997b73b800c req-bb4aa9c9-54d6-4a31-8ca1-f0b701d6e765 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received unexpected event network-vif-plugged-3058f4d2-f621-46ec-b677-b5161dba512f for instance with vm_state deleted and task_state None.
Oct 20 16:34:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-8e2463b5-c091-426b-80f8-1997b73b800c req-bb4aa9c9-54d6-4a31-8ca1-f0b701d6e765 service nova] [instance: 9ff2e5d8-f854-4f8b-941f-17ba5e47caff] Received event network-vif-deleted-3058f4d2-f621-46ec-b677-b5161dba512f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:12 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 is timed out.
Oct 20 16:34:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully detached device vdb from instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 from the live domain config.
Oct 20 16:34:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrxsAmib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:34:12 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f345283c-de86-48bd-8cf9-cbbbbe74609c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:34:12 user nova-compute[74131]: No targets found.
Oct 20 16:34:12 user nova-compute[74131]: iSNS:
Oct 20 16:34:12 user nova-compute[74131]: No targets found.
Oct 20 16:34:12 user nova-compute[74131]: STATIC:
Oct 20 16:34:12 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c
Oct 20 16:34:12 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:12 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:12 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:34:12 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:12 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:12 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:34:12 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:12 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:12 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:34:12 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:34:12 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:34:12 user nova-compute[74131]: FIRMWARE:
Oct 20 16:34:12 user nova-compute[74131]: No targets found.
Oct 20 16:34:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:34:12 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:34:12 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb546f52-adbd-43aa-9313-ee752ea97e1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[030d2ef0-8cca-48c4-a2ec-68d0de0ade94]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:34:12 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:34:12 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:34:12 user nova-compute[74131]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)
Oct 20 16:34:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:34:12 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:34:12 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:34:12 user nova-compute[74131]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c (non-flash)
Oct 20 16:34:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c8716ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c'): ({'sdf'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Removing single pathed devices sdf {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2c7922-4379-44df-b62b-04c094230e8a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4a1fcd-9c32-49fe-9f5a-d867da33d206]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Flushing IO for device /dev/sdf {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856d67b-b6c4-42b5-89da-c8a2220e4640]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f782abe-0268-4b91-bb07-5c197a963372]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ceaca-0226-45b0-a639-5d4775fd6072]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d1ca5-9eff-4339-97e8-cfacae34cc80]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260]
Oct 20 16:34:12 user nova-compute[74131]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c, portal: 172.16.0.220,3260] successful.
Oct 20 16:34:12 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6b3090-eb06-423c-bf78-8ff783773c6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[32724450-f177-48e9-a00f-03036837dd9b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] <== disconnect_volume: return (298ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:34:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:34:13 user nova-compute[74131]: DEBUG nova.objects.instance [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'flavor' on Instance uuid 81225581-aa2b-44dc-a7f0-70c94af0cff3 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:34:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-33deffc1-de9f-4a0d-9332-0b235f6fd972 tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.089s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:34:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:34:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:34:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:34:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:34:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:34:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:34:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:34:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updating instance_info_cache with network_info: [{"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-changed-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Refreshing instance network info cache due to event network-changed-02c962b1-cd04-4515-9995-ede3554c6f07. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] Acquiring lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] Acquired lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Refreshing network info cache for port 02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Updated VIF entry in instance network info cache for port 02c962b1-cd04-4515-9995-ede3554c6f07. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Updating instance_info_cache with network_info: [{"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b11d0ca0-9531-454e-85f5-2812018a5f99 req-23133bd3-d807-47cd-a3d5-fd7644729bc1 service nova] Releasing lock "refresh_cache-7146dad8-b7e6-4d2f-9774-148d3ddda54e" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:31 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:34:31 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=25.201343536376953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 81225581-aa2b-44dc-a7f0-70c94af0cff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 7146dad8-b7e6-4d2f-9774-148d3ddda54e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e30f3de0-f564-4c73-9d9f-7292ceab83b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:34:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:34:41 user nova-compute[74131]: INFO nova.compute.manager [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] instance snapshotting
Oct 20 16:34:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Beginning live snapshot process
Oct 20 16:34:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:42 user nova-compute[74131]: INFO nova.compute.manager [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Terminating instance
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpife3ss_q/581e7f6e29604a73b42f9cf20c478378.delta 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpife3ss_q/581e7f6e29604a73b42f9cf20c478378.delta 1073741824" returned: 0 in 0.059s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-a34b7cda-a467-4de2-b642-9fb178bb54df req-85b9376d-c685-4c9f-a31e-dd6509c7af0d service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-vif-unplugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a34b7cda-a467-4de2-b642-9fb178bb54df req-85b9376d-c685-4c9f-a31e-dd6509c7af0d service nova] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a34b7cda-a467-4de2-b642-9fb178bb54df req-85b9376d-c685-4c9f-a31e-dd6509c7af0d service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a34b7cda-a467-4de2-b642-9fb178bb54df req-85b9376d-c685-4c9f-a31e-dd6509c7af0d service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-a34b7cda-a467-4de2-b642-9fb178bb54df req-85b9376d-c685-4c9f-a31e-dd6509c7af0d service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] No waiting events found dispatching network-vif-unplugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-a34b7cda-a467-4de2-b642-9fb178bb54df req-85b9376d-c685-4c9f-a31e-dd6509c7af0d service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-vif-unplugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:34:42 user nova-compute[74131]: INFO nova.compute.claims [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Claim successful on node user
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:42 user nova-compute[74131]: INFO nova.compute.manager [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Detaching volume a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:34:42 user nova-compute[74131]: INFO nova.virt.block_device [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Attempting to driver detach volume a643ef59-b981-424c-9cd8-e1226055399e from mountpoint /dev/vdb
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Attempting to detach device vdb from instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:34:42 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:34:42 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:34:42 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:34:42 user nova-compute[74131]:   <serial>a643ef59-b981-424c-9cd8-e1226055399e</serial>
Oct 20 16:34:42 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 16:34:42 user nova-compute[74131]: </disk>
Oct 20 16:34:42 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:34:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully detached device vdb from instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 from the persistent domain config.
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:34:42 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:34:42 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:34:42 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:34:42 user nova-compute[74131]:   <serial>a643ef59-b981-424c-9cd8-e1226055399e</serial>
Oct 20 16:34:42 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 16:34:42 user nova-compute[74131]: </disk>
Oct 20 16:34:42 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:34:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:34:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:34:43 user nova-compute[74131]: INFO nova.virt.block_device [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Booting with volume snapshot 351f28de-9b48-4810-bad3-a406002225b7 at /dev/vda
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.policy [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c0f3a5e9862491897ec87644c577ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08267e8d79941d3a555dc3a51c58985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] COPY block job progress, current cursor: 22413312 final cursor: 75563008 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:34:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Instance destroyed successfully.
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lazy-loading 'resources' on Instance uuid 81225581-aa2b-44dc-a7f0-70c94af0cff3 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-739054007',display_name='tempest-AttachVolumeNegativeTest-server-739054007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-739054007',id=28,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxCXaSVNF+LXbTgctM8+a/IbWVKQcu1nXRDWNjzR5FAOvJQs80V8KeuLdeuo790tBdydFznMP2nxlGhNSWUEKwm/m8breoAggbplFwUuiGht3JvAz8p60UQd9iPHowAcA==',key_name='tempest-keypair-1388881125',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac73a0c54fb4583aec623c4c7528428',ramdisk_id='',reservation_id='r-50yu80db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395634699',owner_user_name='tempest-AttachVolumeNegativeTest-395634699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79db1d105a6e406a965eb94987fdfaf3',uuid=81225581-aa2b-44dc-a7f0-70c94af0cff3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converting VIF {"id": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "address": "fa:16:3e:cd:73:e2", "network": {"id": "6d9f20e9-b9fa-4517-9e48-983c565212fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1165856799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac73a0c54fb4583aec623c4c7528428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffa8252-79", "ovs_interfaceid": "dffa8252-791e-4011-aff0-2b2d2ca1c91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:73:e2,bridge_name='br-int',has_traffic_filtering=True,id=dffa8252-791e-4011-aff0-2b2d2ca1c91b,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffa8252-79') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG os_vif [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:73:e2,bridge_name='br-int',has_traffic_filtering=True,id=dffa8252-791e-4011-aff0-2b2d2ca1c91b,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffa8252-79') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdffa8252-79, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4c0e149-7d6b-4d8a-9f70-80952b6f1aae) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:34:43 user nova-compute[74131]: INFO os_vif [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:73:e2,bridge_name='br-int',has_traffic_filtering=True,id=dffa8252-791e-4011-aff0-2b2d2ca1c91b,network=Network(6d9f20e9-b9fa-4517-9e48-983c565212fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffa8252-79')
Oct 20 16:34:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Deleting instance files /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3_del
Oct 20 16:34:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Deletion of /opt/stack/data/nova/instances/81225581-aa2b-44dc-a7f0-70c94af0cff3_del complete
Oct 20 16:34:43 user nova-compute[74131]: INFO nova.compute.manager [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Took 1.79 seconds to destroy the instance on the hypervisor.
Oct 20 16:34:43 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:34:43 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Successfully created port: d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:34:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpife3ss_q/581e7f6e29604a73b42f9cf20c478378.delta /opt/stack/data/nova/instances/snapshots/tmpife3ss_q/581e7f6e29604a73b42f9cf20c478378 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-eabcd417-5e09-44b7-ad78-14ddb0ea3666 req-f3ce890b-c3f9-410b-b7b5-e02dac6e389b service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-eabcd417-5e09-44b7-ad78-14ddb0ea3666 req-f3ce890b-c3f9-410b-b7b5-e02dac6e389b service nova] Acquiring lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-eabcd417-5e09-44b7-ad78-14ddb0ea3666 req-f3ce890b-c3f9-410b-b7b5-e02dac6e389b service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-eabcd417-5e09-44b7-ad78-14ddb0ea3666 req-f3ce890b-c3f9-410b-b7b5-e02dac6e389b service nova] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-eabcd417-5e09-44b7-ad78-14ddb0ea3666 req-f3ce890b-c3f9-410b-b7b5-e02dac6e389b service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] No waiting events found dispatching network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:34:44 user nova-compute[74131]: WARNING nova.compute.manager [req-eabcd417-5e09-44b7-ad78-14ddb0ea3666 req-f3ce890b-c3f9-410b-b7b5-e02dac6e389b service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received unexpected event network-vif-plugged-dffa8252-791e-4011-aff0-2b2d2ca1c91b for instance with vm_state active and task_state deleting.
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Successfully updated port: d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquired lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-changed-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Refreshing instance network info cache due to event network-changed-d07acc65-5b76-49a6-a0c3-b1b633018b89. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] Acquiring lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:34:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpife3ss_q/581e7f6e29604a73b42f9cf20c478378.delta /opt/stack/data/nova/instances/snapshots/tmpife3ss_q/581e7f6e29604a73b42f9cf20c478378" returned: 0 in 0.667s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Snapshot extracted, beginning image upload
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Updating instance_info_cache with network_info: [{"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:45 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Took 1.23 seconds to deallocate network for instance.
Oct 20 16:34:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Releasing lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Instance network_info: |[{"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] Acquired lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Refreshing network info cache for port d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:45 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Deleted allocations for instance 81225581-aa2b-44dc-a7f0-70c94af0cff3
Oct 20 16:34:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5b85d902-2aa5-4e8e-afdb-ceb78dfe064c tempest-AttachVolumeNegativeTest-395634699 tempest-AttachVolumeNegativeTest-395634699-project-member] Lock "81225581-aa2b-44dc-a7f0-70c94af0cff3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.739s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Updated VIF entry in instance network info cache for port d07acc65-5b76-49a6-a0c3-b1b633018b89. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Updating instance_info_cache with network_info: [{"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-314c9fb2-40da-43ef-bbfa-4350006eeba6 req-81ede43c-11cc-4344-97e6-a87d5e2a08ad service nova] Releasing lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:34:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3cecbd5-5891-4637-8763-e2b6fc735c70 req-523d64da-69fa-4744-8110-71835f571667 service nova] [instance: 81225581-aa2b-44dc-a7f0-70c94af0cff3] Received event network-vif-deleted-dffa8252-791e-4011-aff0-2b2d2ca1c91b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Snapshot image upload complete
Oct 20 16:34:47 user nova-compute[74131]: INFO nova.compute.manager [None req-7f7c8873-2b23-41ca-8b85-2548843864cc tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Took 6.52 seconds to snapshot the instance on the hypervisor.
Oct 20 16:34:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG os_brick.utils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0fba32-98ba-41f3-b1fb-505e7829dcf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[207fd910-1a4d-487b-8056-131706aeafe2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0aef64-b7a6-4e31-8c35-30721f5fc38d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[db93b76f-42cc-4c22-923b-4021bc80062b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:34:49 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:34:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df8fa59-7c1c-4811-a8ef-36be013c8b93]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG os_brick.utils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:34:49 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Updating existing volume attachment record: 0949e33f-655c-4cfd-976b-be01ad60b64d {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:34:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:34:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:34:50 user nova-compute[74131]: INFO nova.compute.claims [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Claim successful on node user
Oct 20 16:34:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:51 user nova-compute[74131]: INFO nova.compute.manager [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Unshelving
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:34:51 user nova-compute[74131]: INFO nova.virt.block_device [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Booting with volume 67480b9d-ee42-44ae-bb15-41c5ecb1dc01 at /dev/vda
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b6a438-2358-45ba-85e3-ff5023c64596]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3042b433-ea7a-4170-a96d-47a546b99a0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c4aa47-1eb4-414d-95fe-34078f0ea0f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9585f0f-9ea4-4ec6-b763-9af47c56da4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.policy [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a4098f7e8234722be739368cd364444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c666b56163d8480bb7977e63b2bb534a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:34:51 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f0f1e9-4f29-4beb-81da-ff67a8299bc0]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating existing volume attachment record: 4dae4077-6131-4bcb-ba42-60c231a795d9 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:34:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Creating image(s)
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "/opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "/opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "/opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:53 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Successfully created port: b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:34:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:53 user nova-compute[74131]: DEBUG nova.virt.images [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] 39a16938-10be-4fd0-9f07-39409cb2f049 was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:34:53 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:34:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.part /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.part /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.converted" returned: 0 in 0.486s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.622s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913 --force-share --output=json" returned: 0 in 0.203s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Successfully updated port: b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-changed-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Refreshing instance network info cache due to event network-changed-b11180ef-e4ce-449e-8b4c-4aab6be3ff20. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] Acquiring lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] Acquired lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Refreshing network info cache for port b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913 --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913,backing_fmt=raw /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913,backing_fmt=raw /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk 1073741824" returned: 0 in 0.064s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913 --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Ensure instance console log exists: /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ac58783-53ad-48de-8f4b-46d06b0b7c8b req-26496a2b-aa06-4d00-b937-1c4f23ce8d29 service nova] Releasing lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquired lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updating instance_info_cache with network_info: [{"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Releasing lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Instance network_info: |[{"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Start _get_guest_xml network_info=[{"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4f196c2ae792ca087a21dc13a08e3f6b',container_format='bare',created_at=2023-10-20T16:34:41Z,direct_url=<?>,disk_format='qcow2',id=39a16938-10be-4fd0-9f07-39409cb2f049,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-693212173',owner='c666b56163d8480bb7977e63b2bb534a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T16:34:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '39a16938-10be-4fd0-9f07-39409cb2f049'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:34:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:34:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4f196c2ae792ca087a21dc13a08e3f6b',container_format='bare',created_at=2023-10-20T16:34:41Z,direct_url=<?>,disk_format='qcow2',id=39a16938-10be-4fd0-9f07-39409cb2f049,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-693212173',owner='c666b56163d8480bb7977e63b2bb534a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T16:34:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1686993738',display_name='tempest-TestStampPattern-server-1686993738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1686993738',id=32,image_ref='39a16938-10be-4fd0-9f07-39409cb2f049',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzrap9i4Orsu8IzJ1UVjCZ+WyzfeweRZL/LOfQEErLq7dnmtfZqasg1PuC2aF1xBY+d7pssB1ZDto0my2u854/qSoSCcSBXiI+sw6JGAguv5NwG+H5EAVR6yOkNKhXWPA==',key_name='tempest-TestStampPattern-1512427519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c666b56163d8480bb7977e63b2bb534a',ramdisk_id='',reservation_id='r-9kekvbu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a16108af-bab9-4146-a928-4b2191f6f458',image_min_disk='1',image_min_ram='0',image_owner_id='c666b56163d8480bb7977e63b2bb534a',image_owner_project_name='tempest-TestStampPattern-377185534',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-377185534-project-member',image_user_id='6a4098f7e8234722be739368cd364444',network_allocated='True',owner_project_name='tempest-TestStampPattern-377185534',owner_user_name='tempest-TestStampPattern-377185534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:34:52Z,user_data=None,user_id='6a4098f7e8234722be739368cd364444',uuid=cee5222c-c297-4c9b-9eab-9f3b48d441b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converting VIF {"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb11180ef-e4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'pci_devices' on Instance uuid cee5222c-c297-4c9b-9eab-9f3b48d441b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:34:55 user nova-compute[74131]:   <uuid>cee5222c-c297-4c9b-9eab-9f3b48d441b1</uuid>
Oct 20 16:34:55 user nova-compute[74131]:   <name>instance-00000020</name>
Oct 20 16:34:55 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:34:55 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:34:55 user nova-compute[74131]:   <metadata>
Oct 20 16:34:55 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:34:55 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:34:55 user nova-compute[74131]:       <nova:name>tempest-TestStampPattern-server-1686993738</nova:name>
Oct 20 16:34:55 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:34:55</nova:creationTime>
Oct 20 16:34:55 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:34:55 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:34:55 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:34:55 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:34:55 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:34:55 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:34:55 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:34:55 user nova-compute[74131]:       <nova:owner>
Oct 20 16:34:55 user nova-compute[74131]:         <nova:user uuid="6a4098f7e8234722be739368cd364444">tempest-TestStampPattern-377185534-project-member</nova:user>
Oct 20 16:34:55 user nova-compute[74131]:         <nova:project uuid="c666b56163d8480bb7977e63b2bb534a">tempest-TestStampPattern-377185534</nova:project>
Oct 20 16:34:55 user nova-compute[74131]:       </nova:owner>
Oct 20 16:34:55 user nova-compute[74131]:       <nova:root type="image" uuid="39a16938-10be-4fd0-9f07-39409cb2f049"/>
Oct 20 16:34:55 user nova-compute[74131]:       <nova:ports>
Oct 20 16:34:55 user nova-compute[74131]:         <nova:port uuid="b11180ef-e4ce-449e-8b4c-4aab6be3ff20">
Oct 20 16:34:55 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:34:55 user nova-compute[74131]:         </nova:port>
Oct 20 16:34:55 user nova-compute[74131]:       </nova:ports>
Oct 20 16:34:55 user nova-compute[74131]:     </nova:instance>
Oct 20 16:34:55 user nova-compute[74131]:   </metadata>
Oct 20 16:34:55 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:34:55 user nova-compute[74131]:     <system>
Oct 20 16:34:55 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:34:55 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:34:55 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:34:55 user nova-compute[74131]:       <entry name="serial">cee5222c-c297-4c9b-9eab-9f3b48d441b1</entry>
Oct 20 16:34:55 user nova-compute[74131]:       <entry name="uuid">cee5222c-c297-4c9b-9eab-9f3b48d441b1</entry>
Oct 20 16:34:55 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:34:55 user nova-compute[74131]:     </system>
Oct 20 16:34:55 user nova-compute[74131]:   </sysinfo>
Oct 20 16:34:55 user nova-compute[74131]:   <os>
Oct 20 16:34:55 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:34:55 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:34:55 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:34:55 user nova-compute[74131]:   </os>
Oct 20 16:34:55 user nova-compute[74131]:   <features>
Oct 20 16:34:55 user nova-compute[74131]:     <acpi/>
Oct 20 16:34:55 user nova-compute[74131]:     <apic/>
Oct 20 16:34:55 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:34:55 user nova-compute[74131]:   </features>
Oct 20 16:34:55 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:34:55 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:34:55 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:34:55 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:34:55 user nova-compute[74131]:   </clock>
Oct 20 16:34:55 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:34:55 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:34:55 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:34:55 user nova-compute[74131]:   </cpu>
Oct 20 16:34:55 user nova-compute[74131]:   <devices>
Oct 20 16:34:55 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:34:55 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:34:55 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk"/>
Oct 20 16:34:55 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:34:55 user nova-compute[74131]:     </disk>
Oct 20 16:34:55 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:34:55 user nova-compute[74131]:       <mac address="fa:16:3e:c7:06:f1"/>
Oct 20 16:34:55 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:34:55 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:34:55 user nova-compute[74131]:       <target dev="tapb11180ef-e4"/>
Oct 20 16:34:55 user nova-compute[74131]:     </interface>
Oct 20 16:34:55 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:34:55 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/console.log" append="off"/>
Oct 20 16:34:55 user nova-compute[74131]:     </serial>
Oct 20 16:34:55 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:34:55 user nova-compute[74131]:     <video>
Oct 20 16:34:55 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:34:55 user nova-compute[74131]:     </video>
Oct 20 16:34:55 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:34:55 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:34:55 user nova-compute[74131]:     </rng>
Oct 20 16:34:55 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:34:55 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:34:55 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:34:55 user nova-compute[74131]:     </memballoon>
Oct 20 16:34:55 user nova-compute[74131]:   </devices>
Oct 20 16:34:55 user nova-compute[74131]: </domain>
Oct 20 16:34:55 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1686993738',display_name='tempest-TestStampPattern-server-1686993738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1686993738',id=32,image_ref='39a16938-10be-4fd0-9f07-39409cb2f049',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzrap9i4Orsu8IzJ1UVjCZ+WyzfeweRZL/LOfQEErLq7dnmtfZqasg1PuC2aF1xBY+d7pssB1ZDto0my2u854/qSoSCcSBXiI+sw6JGAguv5NwG+H5EAVR6yOkNKhXWPA==',key_name='tempest-TestStampPattern-1512427519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c666b56163d8480bb7977e63b2bb534a',ramdisk_id='',reservation_id='r-9kekvbu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a16108af-bab9-4146-a928-4b2191f6f458',image_min_disk='1',image_min_ram='0',image_owner_id='c666b56163d8480bb7977e63b2bb534a',image_owner_project_name='tempest-TestStampPattern-377185534',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-377185534-project-member',image_user_id='6a4098f7e8234722be739368cd364444',network_allocated='True',owner_project_name='tempest-TestStampPattern-377185534',owner_user_name='tempest-TestStampPattern-377185534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:34:52Z,user_data=None,user_id='6a4098f7e8234722be739368cd364444',uuid=cee5222c-c297-4c9b-9eab-9f3b48d441b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converting VIF {"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb11180ef-e4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG os_vif [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb11180ef-e4') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '654a92eb-0bd4-579e-b66c-f77116262131', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb11180ef-e4, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb11180ef-e4, col_values=(('qos', UUID('f85f642c-589d-4103-822e-1f420c51b00b')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb11180ef-e4, col_values=(('external_ids', {'iface-id': 'b11180ef-e4ce-449e-8b4c-4aab6be3ff20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:06:f1', 'vm-uuid': 'cee5222c-c297-4c9b-9eab-9f3b48d441b1'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:55 user nova-compute[74131]: INFO os_vif [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb11180ef-e4')
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:34:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No VIF found with MAC fa:16:3e:c7:06:f1, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:34:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-6311e7e9-48d5-446a-b1a3-93f719a95437 req-9211e56b-e317-4c1d-9902-aacb8a076286 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:34:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6311e7e9-48d5-446a-b1a3-93f719a95437 req-9211e56b-e317-4c1d-9902-aacb8a076286 service nova] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:34:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6311e7e9-48d5-446a-b1a3-93f719a95437 req-9211e56b-e317-4c1d-9902-aacb8a076286 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:34:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6311e7e9-48d5-446a-b1a3-93f719a95437 req-9211e56b-e317-4c1d-9902-aacb8a076286 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:34:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-6311e7e9-48d5-446a-b1a3-93f719a95437 req-9211e56b-e317-4c1d-9902-aacb8a076286 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] No waiting events found dispatching network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:34:58 user nova-compute[74131]: WARNING nova.compute.manager [req-6311e7e9-48d5-446a-b1a3-93f719a95437 req-9211e56b-e317-4c1d-9902-aacb8a076286 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received unexpected event network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 for instance with vm_state building and task_state spawning.
Oct 20 16:34:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:34:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:34:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:34:59 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Instance spawned successfully.
Oct 20 16:34:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:34:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:34:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:34:59 user nova-compute[74131]: INFO nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Took 8.20 seconds to spawn the instance on the hypervisor.
Oct 20 16:34:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:34:59 user nova-compute[74131]: INFO nova.compute.manager [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Took 9.23 seconds to build instance.
Oct 20 16:34:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f543533f-49d1-41af-a558-9ba66d364ca8 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.395s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-ea9cf2da-68a7-4f7f-ba1c-202b84a42e5e req-eda670fd-9c55-422a-b7e4-0ac15e92a6d6 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea9cf2da-68a7-4f7f-ba1c-202b84a42e5e req-eda670fd-9c55-422a-b7e4-0ac15e92a6d6 service nova] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea9cf2da-68a7-4f7f-ba1c-202b84a42e5e req-eda670fd-9c55-422a-b7e4-0ac15e92a6d6 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea9cf2da-68a7-4f7f-ba1c-202b84a42e5e req-eda670fd-9c55-422a-b7e4-0ac15e92a6d6 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-ea9cf2da-68a7-4f7f-ba1c-202b84a42e5e req-eda670fd-9c55-422a-b7e4-0ac15e92a6d6 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] No waiting events found dispatching network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:00 user nova-compute[74131]: WARNING nova.compute.manager [req-ea9cf2da-68a7-4f7f-ba1c-202b84a42e5e req-eda670fd-9c55-422a-b7e4-0ac15e92a6d6 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received unexpected event network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 for instance with vm_state active and task_state None.
Oct 20 16:35:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:03 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 is timed out.
Oct 20 16:35:03 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully detached device vdb from instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 from the live domain config.
Oct 20 16:35:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVtcMveW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:35:03 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec66ab5-85e9-44eb-8534-16c6e699bf6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:35:03 user nova-compute[74131]: No targets found.
Oct 20 16:35:03 user nova-compute[74131]: iSNS:
Oct 20 16:35:03 user nova-compute[74131]: No targets found.
Oct 20 16:35:03 user nova-compute[74131]: STATIC:
Oct 20 16:35:03 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:35:03 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:35:03 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:35:03 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:35:03 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:35:03 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:35:03 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e
Oct 20 16:35:03 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:35:03 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:35:03 user nova-compute[74131]: FIRMWARE:
Oct 20 16:35:03 user nova-compute[74131]: No targets found.
Oct 20 16:35:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:35:03 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:35:03 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585893a-5107-40b1-8952-1177f580cc87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[93881059-3f0c-43f1-a9ec-6be4df98553b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:03 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:35:03 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:03 user nova-compute[74131]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e (non-flash)
Oct 20 16:35:03 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:03 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87ecdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b905074-154e-4848-80e5-28998187a17a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec814fc-9a26-4240-beb6-57f3691492bd]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba9b8dc-4afd-416b-8a9d-240273c000b1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c3ba93-cd45-4065-8b4d-a2640b6f9b71]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:35:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e28eee2-2dbf-4626-9180-5f8f8b214a4e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30c97e7-8c41-44f9-878c-923607144b8e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260]
Oct 20 16:35:04 user nova-compute[74131]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e, portal: 172.16.0.220,3260] successful.
Oct 20 16:35:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a643ef59-b981-424c-9cd8-e1226055399e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dd43ae-de3a-40a1-80b0-59fa8b23962a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== disconnect_volume: return (387ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:35:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.objects.instance [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'flavor' on Instance uuid 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb107b54-4a39-40b6-9216-156fcf71423e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.411s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:35:05 user nova-compute[74131]: INFO nova.compute.claims [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Claim successful on node user
Oct 20 16:35:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:35:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:35:05 user nova-compute[74131]: DEBUG nova.policy [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43f5b83594714d9b88c1ba68c6dbf532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a52cd8d5604e8bb772e88a6e524385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:35:06 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Creating image(s)
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.261s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.237s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk 1073741824" returned: 0 in 0.069s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Successfully created port: f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.230s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:35:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Cannot resize image /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Ensure instance console log exists: /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Successfully updated port: f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-changed-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Refreshing instance network info cache due to event network-changed-f5e64e14-ac02-4600-ac9b-9fa85e263786. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance network_info: |[{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.network.neutron [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Refreshing network info cache for port f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Start _get_guest_xml network_info=[{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:35:07 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:07 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:35:07 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:35:08 user nova-compute[74131]:   <uuid>1d3dfe2f-845f-48fa-832b-58335159fd2d</uuid>
Oct 20 16:35:08 user nova-compute[74131]:   <name>instance-00000021</name>
Oct 20 16:35:08 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:35:08 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:35:08 user nova-compute[74131]:   <metadata>
Oct 20 16:35:08 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:35:08 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:35:08 user nova-compute[74131]:       <nova:name>tempest-ServerActionsTestOtherB-server-593432805</nova:name>
Oct 20 16:35:08 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:35:07</nova:creationTime>
Oct 20 16:35:08 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:35:08 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:35:08 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:35:08 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:35:08 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:35:08 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:35:08 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:35:08 user nova-compute[74131]:       <nova:owner>
Oct 20 16:35:08 user nova-compute[74131]:         <nova:user uuid="43f5b83594714d9b88c1ba68c6dbf532">tempest-ServerActionsTestOtherB-915456315-project-member</nova:user>
Oct 20 16:35:08 user nova-compute[74131]:         <nova:project uuid="75a52cd8d5604e8bb772e88a6e524385">tempest-ServerActionsTestOtherB-915456315</nova:project>
Oct 20 16:35:08 user nova-compute[74131]:       </nova:owner>
Oct 20 16:35:08 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:35:08 user nova-compute[74131]:       <nova:ports>
Oct 20 16:35:08 user nova-compute[74131]:         <nova:port uuid="f5e64e14-ac02-4600-ac9b-9fa85e263786">
Oct 20 16:35:08 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:35:08 user nova-compute[74131]:         </nova:port>
Oct 20 16:35:08 user nova-compute[74131]:       </nova:ports>
Oct 20 16:35:08 user nova-compute[74131]:     </nova:instance>
Oct 20 16:35:08 user nova-compute[74131]:   </metadata>
Oct 20 16:35:08 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:35:08 user nova-compute[74131]:     <system>
Oct 20 16:35:08 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:35:08 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:35:08 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:35:08 user nova-compute[74131]:       <entry name="serial">1d3dfe2f-845f-48fa-832b-58335159fd2d</entry>
Oct 20 16:35:08 user nova-compute[74131]:       <entry name="uuid">1d3dfe2f-845f-48fa-832b-58335159fd2d</entry>
Oct 20 16:35:08 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:35:08 user nova-compute[74131]:     </system>
Oct 20 16:35:08 user nova-compute[74131]:   </sysinfo>
Oct 20 16:35:08 user nova-compute[74131]:   <os>
Oct 20 16:35:08 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:35:08 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:35:08 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:35:08 user nova-compute[74131]:   </os>
Oct 20 16:35:08 user nova-compute[74131]:   <features>
Oct 20 16:35:08 user nova-compute[74131]:     <acpi/>
Oct 20 16:35:08 user nova-compute[74131]:     <apic/>
Oct 20 16:35:08 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:35:08 user nova-compute[74131]:   </features>
Oct 20 16:35:08 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:35:08 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:35:08 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:35:08 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:35:08 user nova-compute[74131]:   </clock>
Oct 20 16:35:08 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:35:08 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:35:08 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:35:08 user nova-compute[74131]:   </cpu>
Oct 20 16:35:08 user nova-compute[74131]:   <devices>
Oct 20 16:35:08 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:35:08 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:35:08 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk"/>
Oct 20 16:35:08 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:35:08 user nova-compute[74131]:     </disk>
Oct 20 16:35:08 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:35:08 user nova-compute[74131]:       <mac address="fa:16:3e:45:39:ae"/>
Oct 20 16:35:08 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:08 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:35:08 user nova-compute[74131]:       <target dev="tapf5e64e14-ac"/>
Oct 20 16:35:08 user nova-compute[74131]:     </interface>
Oct 20 16:35:08 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:35:08 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/console.log" append="off"/>
Oct 20 16:35:08 user nova-compute[74131]:     </serial>
Oct 20 16:35:08 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:35:08 user nova-compute[74131]:     <video>
Oct 20 16:35:08 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:08 user nova-compute[74131]:     </video>
Oct 20 16:35:08 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:35:08 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:35:08 user nova-compute[74131]:     </rng>
Oct 20 16:35:08 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:35:08 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:35:08 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:35:08 user nova-compute[74131]:     </memballoon>
Oct 20 16:35:08 user nova-compute[74131]:   </devices>
Oct 20 16:35:08 user nova-compute[74131]: </domain>
Oct 20 16:35:08 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG os_vif [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1f92819-4927-51f3-887a-da0798ac76e5', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e64e14-ac, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e64e14-ac, col_values=(('qos', UUID('762e7e94-8c9c-4316-bd56-58e701b7e151')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e64e14-ac, col_values=(('external_ids', {'iface-id': 'f5e64e14-ac02-4600-ac9b-9fa85e263786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:39:ae', 'vm-uuid': '1d3dfe2f-845f-48fa-832b-58335159fd2d'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:08 user nova-compute[74131]: INFO os_vif [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac')
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No VIF found with MAC fa:16:3e:45:39:ae, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.network.neutron [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updated VIF entry in instance network info cache for port f5e64e14-ac02-4600-ac9b-9fa85e263786. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG nova.network.neutron [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-be3c40dc-9b81-4671-b5b5-eaeea3da703f req-a142e2ae-2300-4540-af43-490a7180b027 service nova] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-65020559-6f2c-43d5-a831-aa9a731fe968 req-b90bb168-1401-4103-9826-f49233ed1b08 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-65020559-6f2c-43d5-a831-aa9a731fe968 req-b90bb168-1401-4103-9826-f49233ed1b08 service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-65020559-6f2c-43d5-a831-aa9a731fe968 req-b90bb168-1401-4103-9826-f49233ed1b08 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-65020559-6f2c-43d5-a831-aa9a731fe968 req-b90bb168-1401-4103-9826-f49233ed1b08 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-65020559-6f2c-43d5-a831-aa9a731fe968 req-b90bb168-1401-4103-9826-f49233ed1b08 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:09 user nova-compute[74131]: WARNING nova.compute.manager [req-65020559-6f2c-43d5-a831-aa9a731fe968 req-b90bb168-1401-4103-9826-f49233ed1b08 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state building and task_state spawning.
Oct 20 16:35:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-17cd2a57-010f-4b7c-b72b-459db5ed74da req-82b3a8eb-93b7-44f5-8dfc-140c73a186da service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-17cd2a57-010f-4b7c-b72b-459db5ed74da req-82b3a8eb-93b7-44f5-8dfc-140c73a186da service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-17cd2a57-010f-4b7c-b72b-459db5ed74da req-82b3a8eb-93b7-44f5-8dfc-140c73a186da service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-17cd2a57-010f-4b7c-b72b-459db5ed74da req-82b3a8eb-93b7-44f5-8dfc-140c73a186da service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-17cd2a57-010f-4b7c-b72b-459db5ed74da req-82b3a8eb-93b7-44f5-8dfc-140c73a186da service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:12 user nova-compute[74131]: WARNING nova.compute.manager [req-17cd2a57-010f-4b7c-b72b-459db5ed74da req-82b3a8eb-93b7-44f5-8dfc-140c73a186da service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state building and task_state spawning.
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:35:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance spawned successfully.
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:12 user nova-compute[74131]: INFO nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Took 6.10 seconds to spawn the instance on the hypervisor.
Oct 20 16:35:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:35:12 user nova-compute[74131]: INFO nova.compute.manager [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Took 7.12 seconds to build instance.
Oct 20 16:35:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5573aa80-ee62-48e1-baf9-4d1bfe0620f3 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.234s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:18 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:35:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:35:21 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Creating image(s)
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Ensure instance console log exists: /opt/stack/data/nova/instances/ab235c2a-ffaa-47c5-87ec-ce03b4129cdd/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Start _get_guest_xml network_info=[{"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T16:34:30Z,direct_url=<?>,disk_format='qcow2',id=89ecf50d-886f-42cf-bff0-5af96f8b7a82,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-920071231',owner='a08267e8d79941d3a555dc3a51c58985',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T16:34:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0949e33f-655c-4cfd-976b-be01ad60b64d', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQhZBfJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab235c2a-ffaa-47c5-87ec-ce03b4129cdd', 'attached_at': '', 'detached_at': '', 'volume_id': '8c2457c0-7ca3-4aec-8b30-cddbe484dccf', 'serial': '8c2457c0-7ca3-4aec-8b30-cddbe484dccf'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:35:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T16:34:30Z,direct_url=<?>,disk_format='qcow2',id=89ecf50d-886f-42cf-bff0-5af96f8b7a82,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-920071231',owner='a08267e8d79941d3a555dc3a51c58985',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T16:34:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQhZBfJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:35:21 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:35:21 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:35:21 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc602923-4c5b-40df-93f9-51129685bb2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:35:21 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f2742-90ce-4b55-bf0e-c339564a1812]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf] added
Oct 20 16:35:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b749d6b-a186-42e2-bb67-652387bc0db1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c3a50f-a1ad-4d27-a8d2-ed1a1cb372b5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQhZBfJY {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQhZBfJY" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[605bff61-807e-401b-88b9-2eb2e1a5130f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uQhZBfJY'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a9231d-66c2-42e8-b46d-4c8fb525f413]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aa2553-effe-4c0e-84d9-9f8ccab572f6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:21 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:21 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9550d9b8-6c8c-45d3-9aab-bf4950c77809]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260]
Oct 20 16:35:21 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260] successful.
Oct 20 16:35:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27e5b51-8512-4860-aa9b-8fa28f66cae9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b38874a-ac46-4cc9-9de1-68c93bd19ae0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:21 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:21 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:35:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:21 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:21 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:35:21 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a666a3fb-37fd-464b-a112-20c75a145738]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:35:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQhZBfJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26536666432346665', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536666432346665', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-806424546',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-806424546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-806424546',id=31,image_ref='89ecf50d-886f-42cf-bff0-5af96f8b7a82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvJUv33ykn1ddmIbtFHyv18KlkpPtSSi48B9ftL+03PX0KlomjXgJitY25qisZXwrWgQf4GWn5nCufsUZ2E8uGjFppCnq1HwM73JhuxQMQt/Yxsp2ptMdZJ3aolRRKTdA==',key_name='tempest-keypair-1202049707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-ouj96dma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-978997028',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=ab235c2a-ffaa-47c5-87ec-ce03b4129cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:95:3b,bridge_name='br-int',has_traffic_filtering=True,id=d07acc65-5b76-49a6-a0c3-b1b633018b89,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07acc65-5b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'pci_devices' on Instance uuid ab235c2a-ffaa-47c5-87ec-ce03b4129cdd {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:35:22 user nova-compute[74131]:   <uuid>ab235c2a-ffaa-47c5-87ec-ce03b4129cdd</uuid>
Oct 20 16:35:22 user nova-compute[74131]:   <name>instance-0000001f</name>
Oct 20 16:35:22 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:35:22 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:35:22 user nova-compute[74131]:   <metadata>
Oct 20 16:35:22 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:35:22 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:35:22 user nova-compute[74131]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-806424546</nova:name>
Oct 20 16:35:22 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:35:21</nova:creationTime>
Oct 20 16:35:22 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:35:22 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:35:22 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:35:22 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:35:22 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:35:22 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:35:22 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:35:22 user nova-compute[74131]:       <nova:owner>
Oct 20 16:35:22 user nova-compute[74131]:         <nova:user uuid="6c0f3a5e9862491897ec87644c577ebf">tempest-TestVolumeBootPattern-978997028-project-member</nova:user>
Oct 20 16:35:22 user nova-compute[74131]:         <nova:project uuid="a08267e8d79941d3a555dc3a51c58985">tempest-TestVolumeBootPattern-978997028</nova:project>
Oct 20 16:35:22 user nova-compute[74131]:       </nova:owner>
Oct 20 16:35:22 user nova-compute[74131]:       <nova:root type="image" uuid="89ecf50d-886f-42cf-bff0-5af96f8b7a82"/>
Oct 20 16:35:22 user nova-compute[74131]:       <nova:ports>
Oct 20 16:35:22 user nova-compute[74131]:         <nova:port uuid="d07acc65-5b76-49a6-a0c3-b1b633018b89">
Oct 20 16:35:22 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 16:35:22 user nova-compute[74131]:         </nova:port>
Oct 20 16:35:22 user nova-compute[74131]:       </nova:ports>
Oct 20 16:35:22 user nova-compute[74131]:     </nova:instance>
Oct 20 16:35:22 user nova-compute[74131]:   </metadata>
Oct 20 16:35:22 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:35:22 user nova-compute[74131]:     <system>
Oct 20 16:35:22 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:35:22 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:35:22 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:35:22 user nova-compute[74131]:       <entry name="serial">ab235c2a-ffaa-47c5-87ec-ce03b4129cdd</entry>
Oct 20 16:35:22 user nova-compute[74131]:       <entry name="uuid">ab235c2a-ffaa-47c5-87ec-ce03b4129cdd</entry>
Oct 20 16:35:22 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:35:22 user nova-compute[74131]:     </system>
Oct 20 16:35:22 user nova-compute[74131]:   </sysinfo>
Oct 20 16:35:22 user nova-compute[74131]:   <os>
Oct 20 16:35:22 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:35:22 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:35:22 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:35:22 user nova-compute[74131]:   </os>
Oct 20 16:35:22 user nova-compute[74131]:   <features>
Oct 20 16:35:22 user nova-compute[74131]:     <acpi/>
Oct 20 16:35:22 user nova-compute[74131]:     <apic/>
Oct 20 16:35:22 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:35:22 user nova-compute[74131]:   </features>
Oct 20 16:35:22 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:35:22 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:35:22 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:35:22 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:35:22 user nova-compute[74131]:   </clock>
Oct 20 16:35:22 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:35:22 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:35:22 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:35:22 user nova-compute[74131]:   </cpu>
Oct 20 16:35:22 user nova-compute[74131]:   <devices>
Oct 20 16:35:22 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:35:22 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:35:22 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 16:35:22 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:35:22 user nova-compute[74131]:       <serial>8c2457c0-7ca3-4aec-8b30-cddbe484dccf</serial>
Oct 20 16:35:22 user nova-compute[74131]:     </disk>
Oct 20 16:35:22 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:35:22 user nova-compute[74131]:       <mac address="fa:16:3e:e6:95:3b"/>
Oct 20 16:35:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:22 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:35:22 user nova-compute[74131]:       <target dev="tapd07acc65-5b"/>
Oct 20 16:35:22 user nova-compute[74131]:     </interface>
Oct 20 16:35:22 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:35:22 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/ab235c2a-ffaa-47c5-87ec-ce03b4129cdd/console.log" append="off"/>
Oct 20 16:35:22 user nova-compute[74131]:     </serial>
Oct 20 16:35:22 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:35:22 user nova-compute[74131]:     <video>
Oct 20 16:35:22 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:22 user nova-compute[74131]:     </video>
Oct 20 16:35:22 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:35:22 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:35:22 user nova-compute[74131]:     </rng>
Oct 20 16:35:22 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:35:22 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:35:22 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:35:22 user nova-compute[74131]:     </memballoon>
Oct 20 16:35:22 user nova-compute[74131]:   </devices>
Oct 20 16:35:22 user nova-compute[74131]: </domain>
Oct 20 16:35:22 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-806424546',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-806424546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-806424546',id=31,image_ref='89ecf50d-886f-42cf-bff0-5af96f8b7a82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvJUv33ykn1ddmIbtFHyv18KlkpPtSSi48B9ftL+03PX0KlomjXgJitY25qisZXwrWgQf4GWn5nCufsUZ2E8uGjFppCnq1HwM73JhuxQMQt/Yxsp2ptMdZJ3aolRRKTdA==',key_name='tempest-keypair-1202049707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-ouj96dma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-978997028',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=ab235c2a-ffaa-47c5-87ec-ce03b4129cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:95:3b,bridge_name='br-int',has_traffic_filtering=True,id=d07acc65-5b76-49a6-a0c3-b1b633018b89,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07acc65-5b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG os_vif [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:95:3b,bridge_name='br-int',has_traffic_filtering=True,id=d07acc65-5b76-49a6-a0c3-b1b633018b89,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07acc65-5b') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c3db18e-38a7-5af2-bd91-19fe4510da88', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd07acc65-5b, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd07acc65-5b, col_values=(('qos', UUID('1a8dcd74-f129-47e0-bfab-fcba909c55fc')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd07acc65-5b, col_values=(('external_ids', {'iface-id': 'd07acc65-5b76-49a6-a0c3-b1b633018b89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:95:3b', 'vm-uuid': 'ab235c2a-ffaa-47c5-87ec-ce03b4129cdd'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:22 user nova-compute[74131]: INFO os_vif [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:95:3b,bridge_name='br-int',has_traffic_filtering=True,id=d07acc65-5b76-49a6-a0c3-b1b633018b89,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07acc65-5b')
Oct 20 16:35:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No VIF found with MAC fa:16:3e:e6:95:3b, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'pci_requests' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:22 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:35:22 user nova-compute[74131]: INFO nova.compute.claims [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Claim successful on node user
Oct 20 16:35:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.906s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:23 user nova-compute[74131]: INFO nova.network.neutron [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating port ddc3a20a-cba1-478b-8092-212e8242efdd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-ce9e0088-b559-401a-b988-cb40dc5e1829 req-45fbd789-3e00-443e-89b5-49f578de83a4 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ce9e0088-b559-401a-b988-cb40dc5e1829 req-45fbd789-3e00-443e-89b5-49f578de83a4 service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ce9e0088-b559-401a-b988-cb40dc5e1829 req-45fbd789-3e00-443e-89b5-49f578de83a4 service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ce9e0088-b559-401a-b988-cb40dc5e1829 req-45fbd789-3e00-443e-89b5-49f578de83a4 service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-ce9e0088-b559-401a-b988-cb40dc5e1829 req-45fbd789-3e00-443e-89b5-49f578de83a4 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:24 user nova-compute[74131]: WARNING nova.compute.manager [req-ce9e0088-b559-401a-b988-cb40dc5e1829 req-45fbd789-3e00-443e-89b5-49f578de83a4 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received unexpected event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with vm_state building and task_state spawning.
Oct 20 16:35:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing instance network info cache due to event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:35:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:35:25 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Creating image(s)
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Ensure instance console log exists: /opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Start _get_guest_xml network_info=[{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4dae4077-6131-4bcb-ba42-60c231a795d9', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c80c4b9-4ab7-45e1-aca6-2bef81ffb635', 'attached_at': '', 'detached_at': '', 'volume_id': '67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'serial': '67480b9d-ee42-44ae-bb15-41c5ecb1dc01'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.network.neutron [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:35:25 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:25 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.objects.instance [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.objects.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Object Instance<2c80c4b9-4ab7-45e1-aca6-2bef81ffb635> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:35:25 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:35:25 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:35:25 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3e5c2d-9982-4ed9-a37e-602523b60bf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:35:25 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[276ac047-7ba4-4926-a63f-48fae1157109]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01] added
Oct 20 16:35:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7684d324-cb5b-491b-a1cf-1f0d3b0cdd88]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7babf6fe-6bd8-4b0b-9709-8c200b28f14f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJgeZKDA {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJgeZKDA" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3cb63-8b07-4688-bb61-0c6a6372cd71]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mJgeZKDA'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa60d6e-ced1-47fd-9eb0-d0eebfb106a4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0f3314-2298-44f3-8dc0-06bdf6618a8a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:35:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:35:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a4b45e-3008-402a-9fbb-36335db88efc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]
Oct 20 16:35:25 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.
Oct 20 16:35:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9d0ccf-134a-4e1a-9f1b-91ebc584785f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.network.neutron [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updated VIF entry in instance network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG nova.network.neutron [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc5daf-a58d-4c2a-91f7-cef954da20d7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:35:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:35:25 user nova-compute[74131]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:35:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-06f566fd-7de5-4168-b9ba-1d2dce6afe3f req-71fdf297-dbe0-45c5-a513-edca3002e48c service nova] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[068fb3ca-4c49-4fcf-a000-d8ac31f9db7e]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:35:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "dd50a97e-e624-4fb5-8818-20e357742c41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:35:26 user nova-compute[74131]: INFO nova.compute.claims [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Claim successful on node user
Oct 20 16:35:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23138326364633030', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138326364633030', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1869711731',display_name='tempest-TestShelveInstance-server-1869711731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1869711731',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1849926161',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92ce29bcf6e2431a92d345a3e739f81e',ramdisk_id='',reservation_id='r-t8xnfbd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1948790584',owner_user_name='tempest-TestShelveInstance-1948790584-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:34:51Z,user_data=None,user_id='059cd89b482d4205a8d7f5a32037afd9',uuid=2c80c4b9-4ab7-45e1-aca6-2bef81ffb635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converting VIF {"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.objects.instance [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.objects.base [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Object Instance<2c80c4b9-4ab7-45e1-aca6-2bef81ffb635> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:35:26 user nova-compute[74131]:   <uuid>2c80c4b9-4ab7-45e1-aca6-2bef81ffb635</uuid>
Oct 20 16:35:26 user nova-compute[74131]:   <name>instance-0000001a</name>
Oct 20 16:35:26 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:35:26 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:35:26 user nova-compute[74131]:   <metadata>
Oct 20 16:35:26 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:35:26 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:35:26 user nova-compute[74131]:       <nova:name>tempest-TestShelveInstance-server-1869711731</nova:name>
Oct 20 16:35:26 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:35:25</nova:creationTime>
Oct 20 16:35:26 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:35:26 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:35:26 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:35:26 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:35:26 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:35:26 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:35:26 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:35:26 user nova-compute[74131]:       <nova:owner>
Oct 20 16:35:26 user nova-compute[74131]:         <nova:user uuid="059cd89b482d4205a8d7f5a32037afd9">tempest-TestShelveInstance-1948790584-project-member</nova:user>
Oct 20 16:35:26 user nova-compute[74131]:         <nova:project uuid="92ce29bcf6e2431a92d345a3e739f81e">tempest-TestShelveInstance-1948790584</nova:project>
Oct 20 16:35:26 user nova-compute[74131]:       </nova:owner>
Oct 20 16:35:26 user nova-compute[74131]:       <nova:ports>
Oct 20 16:35:26 user nova-compute[74131]:         <nova:port uuid="ddc3a20a-cba1-478b-8092-212e8242efdd">
Oct 20 16:35:26 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 16:35:26 user nova-compute[74131]:         </nova:port>
Oct 20 16:35:26 user nova-compute[74131]:       </nova:ports>
Oct 20 16:35:26 user nova-compute[74131]:     </nova:instance>
Oct 20 16:35:26 user nova-compute[74131]:   </metadata>
Oct 20 16:35:26 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:35:26 user nova-compute[74131]:     <system>
Oct 20 16:35:26 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:35:26 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:35:26 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:35:26 user nova-compute[74131]:       <entry name="serial">2c80c4b9-4ab7-45e1-aca6-2bef81ffb635</entry>
Oct 20 16:35:26 user nova-compute[74131]:       <entry name="uuid">2c80c4b9-4ab7-45e1-aca6-2bef81ffb635</entry>
Oct 20 16:35:26 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:35:26 user nova-compute[74131]:     </system>
Oct 20 16:35:26 user nova-compute[74131]:   </sysinfo>
Oct 20 16:35:26 user nova-compute[74131]:   <os>
Oct 20 16:35:26 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:35:26 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:35:26 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:35:26 user nova-compute[74131]:   </os>
Oct 20 16:35:26 user nova-compute[74131]:   <features>
Oct 20 16:35:26 user nova-compute[74131]:     <acpi/>
Oct 20 16:35:26 user nova-compute[74131]:     <apic/>
Oct 20 16:35:26 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:35:26 user nova-compute[74131]:   </features>
Oct 20 16:35:26 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:35:26 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:35:26 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:35:26 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:35:26 user nova-compute[74131]:   </clock>
Oct 20 16:35:26 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:35:26 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:35:26 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:35:26 user nova-compute[74131]:   </cpu>
Oct 20 16:35:26 user nova-compute[74131]:   <devices>
Oct 20 16:35:26 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:35:26 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:35:26 user nova-compute[74131]:       <source dev="/dev/sde"/>
Oct 20 16:35:26 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:35:26 user nova-compute[74131]:       <serial>67480b9d-ee42-44ae-bb15-41c5ecb1dc01</serial>
Oct 20 16:35:26 user nova-compute[74131]:     </disk>
Oct 20 16:35:26 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:35:26 user nova-compute[74131]:       <mac address="fa:16:3e:05:02:41"/>
Oct 20 16:35:26 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:26 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:35:26 user nova-compute[74131]:       <target dev="tapddc3a20a-cb"/>
Oct 20 16:35:26 user nova-compute[74131]:     </interface>
Oct 20 16:35:26 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:35:26 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635/console.log" append="off"/>
Oct 20 16:35:26 user nova-compute[74131]:     </serial>
Oct 20 16:35:26 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:35:26 user nova-compute[74131]:     <video>
Oct 20 16:35:26 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:26 user nova-compute[74131]:     </video>
Oct 20 16:35:26 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:35:26 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:35:26 user nova-compute[74131]:     </rng>
Oct 20 16:35:26 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:35:26 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:35:26 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:35:26 user nova-compute[74131]:     </memballoon>
Oct 20 16:35:26 user nova-compute[74131]:   </devices>
Oct 20 16:35:26 user nova-compute[74131]: </domain>
Oct 20 16:35:26 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1869711731',display_name='tempest-TestShelveInstance-server-1869711731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1869711731',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1849926161',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92ce29bcf6e2431a92d345a3e739f81e',ramdisk_id='',reservation_id='r-t8xnfbd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1948790584',owner_user_name='tempest-TestShelveInstance-1948790584-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:34:51Z,user_data=None,user_id='059cd89b482d4205a8d7f5a32037afd9',uuid=2c80c4b9-4ab7-45e1-aca6-2bef81ffb635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converting VIF {"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG os_vif [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8baf684f-70c9-5316-94d8-9cee2adc44df', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddc3a20a-cb, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddc3a20a-cb, col_values=(('qos', UUID('b83cb63a-3d51-4106-a2b8-9fd0e0d4e9e8')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddc3a20a-cb, col_values=(('external_ids', {'iface-id': 'ddc3a20a-cba1-478b-8092-212e8242efdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:02:41', 'vm-uuid': '2c80c4b9-4ab7-45e1-aca6-2bef81ffb635'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:26 user nova-compute[74131]: INFO os_vif [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb')
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-f0e7e9c0-22e3-4d30-8037-e9ee4330f129 req-a1d71735-1ff3-4a9d-b096-308c7b09f7f3 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f0e7e9c0-22e3-4d30-8037-e9ee4330f129 req-a1d71735-1ff3-4a9d-b096-308c7b09f7f3 service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f0e7e9c0-22e3-4d30-8037-e9ee4330f129 req-a1d71735-1ff3-4a9d-b096-308c7b09f7f3 service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f0e7e9c0-22e3-4d30-8037-e9ee4330f129 req-a1d71735-1ff3-4a9d-b096-308c7b09f7f3 service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-f0e7e9c0-22e3-4d30-8037-e9ee4330f129 req-a1d71735-1ff3-4a9d-b096-308c7b09f7f3 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:26 user nova-compute[74131]: WARNING nova.compute.manager [req-f0e7e9c0-22e3-4d30-8037-e9ee4330f129 req-a1d71735-1ff3-4a9d-b096-308c7b09f7f3 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received unexpected event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with vm_state building and task_state spawning.
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:35:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] No VIF found with MAC fa:16:3e:05:02:41, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:35:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Instance spawned successfully.
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:27 user nova-compute[74131]: INFO nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Took 6.00 seconds to spawn the instance on the hypervisor.
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:27 user nova-compute[74131]: INFO nova.compute.manager [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Took 45.02 seconds to build instance.
Oct 20 16:35:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.944s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-21806e9a-9680-42b2-8b8a-042ab4965a3a tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.140s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:35:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.policy [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82534b86e314f00896042e2e684a623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097a2eccca244cbfa897e6a573a3113d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:35:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Creating image(s)
Oct 20 16:35:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.227s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk 1073741824" returned: 0 in 0.108s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Successfully created port: b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.291s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-4795cbb5-602a-40b4-9f05-b8d35be53b23 req-1c1a7986-e3b2-41b6-802b-dd4bb2bef431 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4795cbb5-602a-40b4-9f05-b8d35be53b23 req-1c1a7986-e3b2-41b6-802b-dd4bb2bef431 service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4795cbb5-602a-40b4-9f05-b8d35be53b23 req-1c1a7986-e3b2-41b6-802b-dd4bb2bef431 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4795cbb5-602a-40b4-9f05-b8d35be53b23 req-1c1a7986-e3b2-41b6-802b-dd4bb2bef431 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-4795cbb5-602a-40b4-9f05-b8d35be53b23 req-1c1a7986-e3b2-41b6-802b-dd4bb2bef431 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:28 user nova-compute[74131]: WARNING nova.compute.manager [req-4795cbb5-602a-40b4-9f05-b8d35be53b23 req-1c1a7986-e3b2-41b6-802b-dd4bb2bef431 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received unexpected event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Cannot resize image /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Ensure instance console log exists: /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating instance_info_cache with network_info: [{"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Successfully updated port: b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-4fdc0030-fba0-4beb-bfd5-b1179c1868a1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received event network-changed-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Refreshing instance network info cache due to event network-changed-b33a9b4c-c491-4b77-a708-4811da846517. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] Acquiring lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:35:29 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.network.neutron [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Updating instance_info_cache with network_info: [{"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Instance network_info: |[{"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] Acquired lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.network.neutron [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Refreshing network info cache for port b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Start _get_guest_xml network_info=[{"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:35:30 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:30 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1720470027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1720470027',id=34,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-oamyfnjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:28Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=dd50a97e-e624-4fb5-8818-20e357742c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0b:44,bridge_name='br-int',has_traffic_filtering=True,id=b33a9b4c-c491-4b77-a708-4811da846517,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33a9b4c-c4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'pci_devices' on Instance uuid dd50a97e-e624-4fb5-8818-20e357742c41 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:35:30 user nova-compute[74131]:   <uuid>dd50a97e-e624-4fb5-8818-20e357742c41</uuid>
Oct 20 16:35:30 user nova-compute[74131]:   <name>instance-00000022</name>
Oct 20 16:35:30 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:35:30 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:35:30 user nova-compute[74131]:   <metadata>
Oct 20 16:35:30 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:35:30 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:35:30 user nova-compute[74131]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1720470027</nova:name>
Oct 20 16:35:30 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:35:30</nova:creationTime>
Oct 20 16:35:30 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:35:30 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:35:30 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:35:30 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:35:30 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:35:30 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:35:30 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:35:30 user nova-compute[74131]:       <nova:owner>
Oct 20 16:35:30 user nova-compute[74131]:         <nova:user uuid="a82534b86e314f00896042e2e684a623">tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member</nova:user>
Oct 20 16:35:30 user nova-compute[74131]:         <nova:project uuid="097a2eccca244cbfa897e6a573a3113d">tempest-ServerBootFromVolumeStableRescueTest-131352591</nova:project>
Oct 20 16:35:30 user nova-compute[74131]:       </nova:owner>
Oct 20 16:35:30 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:35:30 user nova-compute[74131]:       <nova:ports>
Oct 20 16:35:30 user nova-compute[74131]:         <nova:port uuid="b33a9b4c-c491-4b77-a708-4811da846517">
Oct 20 16:35:30 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:35:30 user nova-compute[74131]:         </nova:port>
Oct 20 16:35:30 user nova-compute[74131]:       </nova:ports>
Oct 20 16:35:30 user nova-compute[74131]:     </nova:instance>
Oct 20 16:35:30 user nova-compute[74131]:   </metadata>
Oct 20 16:35:30 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:35:30 user nova-compute[74131]:     <system>
Oct 20 16:35:30 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:35:30 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:35:30 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:35:30 user nova-compute[74131]:       <entry name="serial">dd50a97e-e624-4fb5-8818-20e357742c41</entry>
Oct 20 16:35:30 user nova-compute[74131]:       <entry name="uuid">dd50a97e-e624-4fb5-8818-20e357742c41</entry>
Oct 20 16:35:30 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:35:30 user nova-compute[74131]:     </system>
Oct 20 16:35:30 user nova-compute[74131]:   </sysinfo>
Oct 20 16:35:30 user nova-compute[74131]:   <os>
Oct 20 16:35:30 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:35:30 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:35:30 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:35:30 user nova-compute[74131]:   </os>
Oct 20 16:35:30 user nova-compute[74131]:   <features>
Oct 20 16:35:30 user nova-compute[74131]:     <acpi/>
Oct 20 16:35:30 user nova-compute[74131]:     <apic/>
Oct 20 16:35:30 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:35:30 user nova-compute[74131]:   </features>
Oct 20 16:35:30 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:35:30 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:35:30 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:35:30 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:35:30 user nova-compute[74131]:   </clock>
Oct 20 16:35:30 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:35:30 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:35:30 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:35:30 user nova-compute[74131]:   </cpu>
Oct 20 16:35:30 user nova-compute[74131]:   <devices>
Oct 20 16:35:30 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:35:30 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:35:30 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk"/>
Oct 20 16:35:30 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:35:30 user nova-compute[74131]:     </disk>
Oct 20 16:35:30 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:35:30 user nova-compute[74131]:       <mac address="fa:16:3e:cc:0b:44"/>
Oct 20 16:35:30 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:30 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:35:30 user nova-compute[74131]:       <target dev="tapb33a9b4c-c4"/>
Oct 20 16:35:30 user nova-compute[74131]:     </interface>
Oct 20 16:35:30 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:35:30 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/console.log" append="off"/>
Oct 20 16:35:30 user nova-compute[74131]:     </serial>
Oct 20 16:35:30 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:35:30 user nova-compute[74131]:     <video>
Oct 20 16:35:30 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:30 user nova-compute[74131]:     </video>
Oct 20 16:35:30 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:35:30 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:35:30 user nova-compute[74131]:     </rng>
Oct 20 16:35:30 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:35:30 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:35:30 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:35:30 user nova-compute[74131]:     </memballoon>
Oct 20 16:35:30 user nova-compute[74131]:   </devices>
Oct 20 16:35:30 user nova-compute[74131]: </domain>
Oct 20 16:35:30 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1720470027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1720470027',id=34,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-oamyfnjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:28Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=dd50a97e-e624-4fb5-8818-20e357742c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0b:44,bridge_name='br-int',has_traffic_filtering=True,id=b33a9b4c-c491-4b77-a708-4811da846517,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33a9b4c-c4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG os_vif [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0b:44,bridge_name='br-int',has_traffic_filtering=True,id=b33a9b4c-c491-4b77-a708-4811da846517,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33a9b4c-c4') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '113118d8-07b5-5068-9198-b410626084ac', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb33a9b4c-c4, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb33a9b4c-c4, col_values=(('qos', UUID('ca0c1cf6-266e-4099-bfa3-ff27e26edec4')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb33a9b4c-c4, col_values=(('external_ids', {'iface-id': 'b33a9b4c-c491-4b77-a708-4811da846517', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:0b:44', 'vm-uuid': 'dd50a97e-e624-4fb5-8818-20e357742c41'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:30 user nova-compute[74131]: INFO os_vif [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0b:44,bridge_name='br-int',has_traffic_filtering=True,id=b33a9b4c-c491-4b77-a708-4811da846517,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33a9b4c-c4')
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-63958bc6-6f37-4edd-8ff1-35e870705f1a req-f4c118de-5a94-42db-ab42-b6902c92bad0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63958bc6-6f37-4edd-8ff1-35e870705f1a req-f4c118de-5a94-42db-ab42-b6902c92bad0 service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63958bc6-6f37-4edd-8ff1-35e870705f1a req-f4c118de-5a94-42db-ab42-b6902c92bad0 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-63958bc6-6f37-4edd-8ff1-35e870705f1a req-f4c118de-5a94-42db-ab42-b6902c92bad0 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-63958bc6-6f37-4edd-8ff1-35e870705f1a req-f4c118de-5a94-42db-ab42-b6902c92bad0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:30 user nova-compute[74131]: WARNING nova.compute.manager [req-63958bc6-6f37-4edd-8ff1-35e870705f1a req-f4c118de-5a94-42db-ab42-b6902c92bad0 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received unexpected event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No VIF found with MAC fa:16:3e:cc:0b:44, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:35:31 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance spawned successfully.
Oct 20 16:35:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-467924a6-0724-46bf-8013-39adeea01ad6 tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 40.167s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG nova.network.neutron [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Updated VIF entry in instance network info cache for port b33a9b4c-c491-4b77-a708-4811da846517. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG nova.network.neutron [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Updating instance_info_cache with network_info: [{"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-77485e41-bf0c-42dc-98ce-9694a08719cb req-e44d2b59-4220-482d-81b8-31d447283788 service nova] Releasing lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-9526f06e-fef8-4142-b0ce-cc436757ac81 req-9174994c-aad2-455a-a5fd-2d555e6d8c46 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received event network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9526f06e-fef8-4142-b0ce-cc436757ac81 req-9174994c-aad2-455a-a5fd-2d555e6d8c46 service nova] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9526f06e-fef8-4142-b0ce-cc436757ac81 req-9174994c-aad2-455a-a5fd-2d555e6d8c46 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9526f06e-fef8-4142-b0ce-cc436757ac81 req-9174994c-aad2-455a-a5fd-2d555e6d8c46 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-9526f06e-fef8-4142-b0ce-cc436757ac81 req-9174994c-aad2-455a-a5fd-2d555e6d8c46 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] No waiting events found dispatching network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:32 user nova-compute[74131]: WARNING nova.compute.manager [req-9526f06e-fef8-4142-b0ce-cc436757ac81 req-9174994c-aad2-455a-a5fd-2d555e6d8c46 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received unexpected event network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 for instance with vm_state building and task_state spawning.
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:35:32 user nova-compute[74131]: INFO nova.compute.claims [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Claim successful on node user
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:33 user nova-compute[74131]: INFO nova.compute.manager [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Terminating instance
Oct 20 16:35:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:35:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-92914f72-777f-4cb8-ac97-dbbcc4f3cf84 req-dee95b61-34db-4042-b724-b7c5476eba80 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-92914f72-777f-4cb8-ac97-dbbcc4f3cf84 req-dee95b61-34db-4042-b724-b7c5476eba80 service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-92914f72-777f-4cb8-ac97-dbbcc4f3cf84 req-dee95b61-34db-4042-b724-b7c5476eba80 service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-92914f72-777f-4cb8-ac97-dbbcc4f3cf84 req-dee95b61-34db-4042-b724-b7c5476eba80 service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-92914f72-777f-4cb8-ac97-dbbcc4f3cf84 req-dee95b61-34db-4042-b724-b7c5476eba80 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-92914f72-777f-4cb8-ac97-dbbcc4f3cf84 req-dee95b61-34db-4042-b724-b7c5476eba80 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-unplugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:35:34 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:34 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=25.034866333007812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Instance destroyed successfully.
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'resources' on Instance uuid 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-922119915',display_name='tempest-ServerActionsTestOtherA-server-1571890221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-922119915',id=22,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClsw25KmejLndYBIRuFDpZeoBzz0XFoBnGaNFpUkFZ2ueCXES09aknXNcKDwgLJ0hSqiuxQFmvUMbjJI9W+CvysCsH9vDWL9/yf5HU69VDrewq3TaRiKAWilU8ELN8rSg==',key_name='tempest-keypair-41371766',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:32:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-p30mggky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=4fdc0030-fba0-4beb-bfd5-b1179c1868a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "address": "fa:16:3e:78:ef:ca", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e77cb4a-26", "ovs_interfaceid": "9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG os_vif [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e77cb4a-26, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86e2f5da-5723-40c4-b903-921ec3c3b3bd) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:34 user nova-compute[74131]: INFO os_vif [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ef:ca,bridge_name='br-int',has_traffic_filtering=True,id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e77cb4a-26')
Oct 20 16:35:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Deleting instance files /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1_del
Oct 20 16:35:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Deletion of /opt/stack/data/nova/instances/4fdc0030-fba0-4beb-bfd5-b1179c1868a1_del complete
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.862s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.172s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:34 user nova-compute[74131]: INFO nova.compute.manager [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:35:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-a11b349c-de49-496e-a828-18a83e9fa31b req-8a03b60b-ff4d-4554-bb10-032f83c817e5 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received event network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a11b349c-de49-496e-a828-18a83e9fa31b req-8a03b60b-ff4d-4554-bb10-032f83c817e5 service nova] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a11b349c-de49-496e-a828-18a83e9fa31b req-8a03b60b-ff4d-4554-bb10-032f83c817e5 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a11b349c-de49-496e-a828-18a83e9fa31b req-8a03b60b-ff4d-4554-bb10-032f83c817e5 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-a11b349c-de49-496e-a828-18a83e9fa31b req-8a03b60b-ff4d-4554-bb10-032f83c817e5 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] No waiting events found dispatching network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:34 user nova-compute[74131]: WARNING nova.compute.manager [req-a11b349c-de49-496e-a828-18a83e9fa31b req-8a03b60b-ff4d-4554-bb10-032f83c817e5 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received unexpected event network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 for instance with vm_state building and task_state spawning.
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.policy [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea2a757da8e46dda15f3e996a94940f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795f458a4c844238e9dece3464d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 7146dad8-b7e6-4d2f-9774-148d3ddda54e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e30f3de0-f564-4c73-9d9f-7292ceab83b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance ab235c2a-ffaa-47c5-87ec-ce03b4129cdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:35:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Creating image(s)
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:35:35 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Instance spawned successfully.
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.229s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:35 user nova-compute[74131]: INFO nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Took 7.44 seconds to spawn the instance on the hypervisor.
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:35 user nova-compute[74131]: INFO nova.compute.manager [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Took 8.93 seconds to build instance.
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a6e0d802-024c-4c71-aec2-76c16bd740e0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "dd50a97e-e624-4fb5-8818-20e357742c41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.079s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.288s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk 1073741824" returned: 0 in 0.074s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-ae6d87da-42fe-4f12-894e-8e4431bd86a1 req-208e4b2f-d917-41a2-af9b-6cd36ee54e62 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ae6d87da-42fe-4f12-894e-8e4431bd86a1 req-208e4b2f-d917-41a2-af9b-6cd36ee54e62 service nova] Acquiring lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ae6d87da-42fe-4f12-894e-8e4431bd86a1 req-208e4b2f-d917-41a2-af9b-6cd36ee54e62 service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ae6d87da-42fe-4f12-894e-8e4431bd86a1 req-208e4b2f-d917-41a2-af9b-6cd36ee54e62 service nova] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-ae6d87da-42fe-4f12-894e-8e4431bd86a1 req-208e4b2f-d917-41a2-af9b-6cd36ee54e62 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] No waiting events found dispatching network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:35 user nova-compute[74131]: WARNING nova.compute.manager [req-ae6d87da-42fe-4f12-894e-8e4431bd86a1 req-208e4b2f-d917-41a2-af9b-6cd36ee54e62 service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received unexpected event network-vif-plugged-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e for instance with vm_state active and task_state deleting.
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.081s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Successfully created port: 334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.277s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-ceb5f2d2-6c56-4bf6-8f5b-0a7606a71635 req-02d41c3c-fcfe-4d06-b613-718ca8605d7f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Received event network-vif-deleted-9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:35 user nova-compute[74131]: INFO nova.compute.manager [req-ceb5f2d2-6c56-4bf6-8f5b-0a7606a71635 req-02d41c3c-fcfe-4d06-b613-718ca8605d7f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Neutron deleted interface 9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e; detaching it from the instance and deleting it from the info cache
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-ceb5f2d2-6c56-4bf6-8f5b-0a7606a71635 req-02d41c3c-fcfe-4d06-b613-718ca8605d7f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:35 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Took 1.25 seconds to deallocate network for instance.
Oct 20 16:35:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-ceb5f2d2-6c56-4bf6-8f5b-0a7606a71635 req-02d41c3c-fcfe-4d06-b613-718ca8605d7f service nova] [instance: 4fdc0030-fba0-4beb-bfd5-b1179c1868a1] Detach interface failed, port_id=9e77cb4a-2691-43e0-b4ac-ac0c2c06e32e, reason: Instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Cannot resize image /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Ensure instance console log exists: /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Successfully updated port: 334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquired lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.653s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:36 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Deleted allocations for instance 4fdc0030-fba0-4beb-bfd5-b1179c1868a1
Oct 20 16:35:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ed4de97f-8b9d-4a35-9b0f-44dd0f9680e6 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "4fdc0030-fba0-4beb-bfd5-b1179c1868a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.620s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Releasing lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance network_info: |[{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Start _get_guest_xml network_info=[{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:35:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.objects.instance [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'pci_devices' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:35:37 user nova-compute[74131]:   <uuid>f77f165e-a8f0-4352-b8d0-bb48cf325369</uuid>
Oct 20 16:35:37 user nova-compute[74131]:   <name>instance-00000023</name>
Oct 20 16:35:37 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:35:37 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:35:37 user nova-compute[74131]:   <metadata>
Oct 20 16:35:37 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:35:37 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:35:37 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeTestJSON-server-57709410</nova:name>
Oct 20 16:35:37 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:35:37</nova:creationTime>
Oct 20 16:35:37 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:35:37 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:35:37 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:35:37 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:35:37 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:35:37 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:35:37 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:35:37 user nova-compute[74131]:       <nova:owner>
Oct 20 16:35:37 user nova-compute[74131]:         <nova:user uuid="fea2a757da8e46dda15f3e996a94940f">tempest-AttachVolumeTestJSON-791392427-project-member</nova:user>
Oct 20 16:35:37 user nova-compute[74131]:         <nova:project uuid="7795f458a4c844238e9dece3464d4b69">tempest-AttachVolumeTestJSON-791392427</nova:project>
Oct 20 16:35:37 user nova-compute[74131]:       </nova:owner>
Oct 20 16:35:37 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:35:37 user nova-compute[74131]:       <nova:ports>
Oct 20 16:35:37 user nova-compute[74131]:         <nova:port uuid="334ce2d7-c655-430b-8c98-25c37e643e6a">
Oct 20 16:35:37 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:35:37 user nova-compute[74131]:         </nova:port>
Oct 20 16:35:37 user nova-compute[74131]:       </nova:ports>
Oct 20 16:35:37 user nova-compute[74131]:     </nova:instance>
Oct 20 16:35:37 user nova-compute[74131]:   </metadata>
Oct 20 16:35:37 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:35:37 user nova-compute[74131]:     <system>
Oct 20 16:35:37 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:35:37 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:35:37 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:35:37 user nova-compute[74131]:       <entry name="serial">f77f165e-a8f0-4352-b8d0-bb48cf325369</entry>
Oct 20 16:35:37 user nova-compute[74131]:       <entry name="uuid">f77f165e-a8f0-4352-b8d0-bb48cf325369</entry>
Oct 20 16:35:37 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:35:37 user nova-compute[74131]:     </system>
Oct 20 16:35:37 user nova-compute[74131]:   </sysinfo>
Oct 20 16:35:37 user nova-compute[74131]:   <os>
Oct 20 16:35:37 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:35:37 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:35:37 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:35:37 user nova-compute[74131]:   </os>
Oct 20 16:35:37 user nova-compute[74131]:   <features>
Oct 20 16:35:37 user nova-compute[74131]:     <acpi/>
Oct 20 16:35:37 user nova-compute[74131]:     <apic/>
Oct 20 16:35:37 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:35:37 user nova-compute[74131]:   </features>
Oct 20 16:35:37 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:35:37 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:35:37 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:35:37 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:35:37 user nova-compute[74131]:   </clock>
Oct 20 16:35:37 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:35:37 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:35:37 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:35:37 user nova-compute[74131]:   </cpu>
Oct 20 16:35:37 user nova-compute[74131]:   <devices>
Oct 20 16:35:37 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:35:37 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:35:37 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk"/>
Oct 20 16:35:37 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:35:37 user nova-compute[74131]:     </disk>
Oct 20 16:35:37 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:35:37 user nova-compute[74131]:       <mac address="fa:16:3e:28:94:04"/>
Oct 20 16:35:37 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:37 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:35:37 user nova-compute[74131]:       <target dev="tap334ce2d7-c6"/>
Oct 20 16:35:37 user nova-compute[74131]:     </interface>
Oct 20 16:35:37 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:35:37 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/console.log" append="off"/>
Oct 20 16:35:37 user nova-compute[74131]:     </serial>
Oct 20 16:35:37 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:35:37 user nova-compute[74131]:     <video>
Oct 20 16:35:37 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:37 user nova-compute[74131]:     </video>
Oct 20 16:35:37 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:35:37 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:35:37 user nova-compute[74131]:     </rng>
Oct 20 16:35:37 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:35:37 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:35:37 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:35:37 user nova-compute[74131]:     </memballoon>
Oct 20 16:35:37 user nova-compute[74131]:   </devices>
Oct 20 16:35:37 user nova-compute[74131]: </domain>
Oct 20 16:35:37 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG os_vif [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f89ea0-f2fc-5622-bff6-65b8cb764fa9', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap334ce2d7-c6, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap334ce2d7-c6, col_values=(('qos', UUID('349000cb-71eb-4987-b402-e9779500b4cb')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap334ce2d7-c6, col_values=(('external_ids', {'iface-id': '334ce2d7-c655-430b-8c98-25c37e643e6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:94:04', 'vm-uuid': 'f77f165e-a8f0-4352-b8d0-bb48cf325369'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:37 user nova-compute[74131]: INFO os_vif [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6')
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No VIF found with MAC fa:16:3e:28:94:04, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-changed-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Refreshing instance network info cache due to event network-changed-334ce2d7-c655-430b-8c98-25c37e643e6a. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] Acquiring lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] Acquired lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:37 user nova-compute[74131]: DEBUG nova.network.neutron [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Refreshing network info cache for port 334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:35:38 user nova-compute[74131]: DEBUG nova.network.neutron [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updated VIF entry in instance network info cache for port 334ce2d7-c655-430b-8c98-25c37e643e6a. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:35:38 user nova-compute[74131]: DEBUG nova.network.neutron [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-577e0eaf-a2ac-4fee-b3e9-593df193c80c req-648b14b0-1d4c-4607-b2ff-121e6030a634 service nova] Releasing lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-387b340d-6d4e-495b-8d1d-761aa0207a92 req-4196dcb9-c4e4-49b3-86bb-bdf5030a9718 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-387b340d-6d4e-495b-8d1d-761aa0207a92 req-4196dcb9-c4e4-49b3-86bb-bdf5030a9718 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-387b340d-6d4e-495b-8d1d-761aa0207a92 req-4196dcb9-c4e4-49b3-86bb-bdf5030a9718 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-387b340d-6d4e-495b-8d1d-761aa0207a92 req-4196dcb9-c4e4-49b3-86bb-bdf5030a9718 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-387b340d-6d4e-495b-8d1d-761aa0207a92 req-4196dcb9-c4e4-49b3-86bb-bdf5030a9718 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:39 user nova-compute[74131]: WARNING nova.compute.manager [req-387b340d-6d4e-495b-8d1d-761aa0207a92 req-4196dcb9-c4e4-49b3-86bb-bdf5030a9718 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state building and task_state spawning.
Oct 20 16:35:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-ea5169d9-4098-4243-b5ab-066599b009e8 req-f381ae22-9912-413d-b5e5-47d14ac16dda service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea5169d9-4098-4243-b5ab-066599b009e8 req-f381ae22-9912-413d-b5e5-47d14ac16dda service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea5169d9-4098-4243-b5ab-066599b009e8 req-f381ae22-9912-413d-b5e5-47d14ac16dda service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ea5169d9-4098-4243-b5ab-066599b009e8 req-f381ae22-9912-413d-b5e5-47d14ac16dda service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-ea5169d9-4098-4243-b5ab-066599b009e8 req-f381ae22-9912-413d-b5e5-47d14ac16dda service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:41 user nova-compute[74131]: WARNING nova.compute.manager [req-ea5169d9-4098-4243-b5ab-066599b009e8 req-f381ae22-9912-413d-b5e5-47d14ac16dda service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state building and task_state spawning.
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:35:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance spawned successfully.
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:35:41 user nova-compute[74131]: INFO nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Took 6.99 seconds to spawn the instance on the hypervisor.
Oct 20 16:35:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:35:42 user nova-compute[74131]: INFO nova.compute.manager [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Took 9.33 seconds to build instance.
Oct 20 16:35:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-782f6f07-b2bc-4141-90ab-77e19a1ba2c0 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.593s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing instance network info cache due to event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] Acquiring lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] Acquired lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updated VIF entry in instance network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e65bcfff-2f30-4753-a6a1-9d9c323d4bbd req-e68f2f77-7515-4a8d-9c87-d3d05cba8064 service nova] Releasing lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 46c22ead-b9e5-4f15-8a36-f62c56dd5977 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 562d3ea2-1242-44ef-938c-7e2113d46496 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid a16108af-bab9-4146-a928-4b2191f6f458 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 7146dad8-b7e6-4d2f-9774-148d3ddda54e {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid ab235c2a-ffaa-47c5-87ec-ce03b4129cdd {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid cee5222c-c297-4c9b-9eab-9f3b48d441b1 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid dd50a97e-e624-4fb5-8818-20e357742c41 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a16108af-bab9-4146-a928-4b2191f6f458" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: INFO nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] During sync_power_state the instance has a pending task (shelving). Skip.
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "dd50a97e-e624-4fb5-8818-20e357742c41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a16108af-bab9-4146-a928-4b2191f6f458" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "dd50a97e-e624-4fb5-8818-20e357742c41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:50 user nova-compute[74131]: INFO nova.compute.manager [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Shelving
Oct 20 16:35:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance destroyed successfully.
Oct 20 16:35:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Beginning cold snapshot process
Oct 20 16:35:51 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:35:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk /opt/stack/data/nova/instances/snapshots/tmpuvzpusuq/67be242210094436902fcb85674f0c62 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-7cbb5606-607d-4eaf-940a-9938fe418dbe req-02e67c89-bcb4-437c-99f6-545442b89e2f service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-unplugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7cbb5606-607d-4eaf-940a-9938fe418dbe req-02e67c89-bcb4-437c-99f6-545442b89e2f service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7cbb5606-607d-4eaf-940a-9938fe418dbe req-02e67c89-bcb4-437c-99f6-545442b89e2f service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7cbb5606-607d-4eaf-940a-9938fe418dbe req-02e67c89-bcb4-437c-99f6-545442b89e2f service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-7cbb5606-607d-4eaf-940a-9938fe418dbe req-02e67c89-bcb4-437c-99f6-545442b89e2f service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-unplugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:52 user nova-compute[74131]: WARNING nova.compute.manager [req-7cbb5606-607d-4eaf-940a-9938fe418dbe req-02e67c89-bcb4-437c-99f6-545442b89e2f service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received unexpected event network-vif-unplugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 20 16:35:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk /opt/stack/data/nova/instances/snapshots/tmpuvzpusuq/67be242210094436902fcb85674f0c62" returned: 0 in 1.036s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Snapshot extracted, beginning image upload
Oct 20 16:35:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "f7bd2fd9-b592-45d4-a782-5d5e59452366" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:35:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:35:53 user nova-compute[74131]: INFO nova.compute.claims [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Claim successful on node user
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-8bd3a4b6-9a34-475d-8840-2d643005592e req-5fe5cdf4-4f93-4417-9363-af201f1dea12 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8bd3a4b6-9a34-475d-8840-2d643005592e req-5fe5cdf4-4f93-4417-9363-af201f1dea12 service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8bd3a4b6-9a34-475d-8840-2d643005592e req-5fe5cdf4-4f93-4417-9363-af201f1dea12 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8bd3a4b6-9a34-475d-8840-2d643005592e req-5fe5cdf4-4f93-4417-9363-af201f1dea12 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-8bd3a4b6-9a34-475d-8840-2d643005592e req-5fe5cdf4-4f93-4417-9363-af201f1dea12 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:54 user nova-compute[74131]: WARNING nova.compute.manager [req-8bd3a4b6-9a34-475d-8840-2d643005592e req-5fe5cdf4-4f93-4417-9363-af201f1dea12 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received unexpected event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:35:54 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.policy [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '920bc059cf2644199effa540a62c07ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ae0ab6863f4f07a65fbe7bc98e1e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:35:54 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Creating image(s)
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "/opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "/opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk 1073741824" returned: 0 in 0.063s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:55 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Snapshot image upload complete
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Cannot resize image /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Ensure instance console log exists: /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Successfully created port: 360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:35:55 user nova-compute[74131]: INFO nova.compute.manager [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Shelve offloading
Oct 20 16:35:55 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance destroyed successfully.
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquired lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Releasing lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Successfully updated port: 360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "refresh_cache-f7bd2fd9-b592-45d4-a782-5d5e59452366" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquired lock "refresh_cache-f7bd2fd9-b592-45d4-a782-5d5e59452366" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received event network-changed-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Refreshing instance network info cache due to event network-changed-360cfcfa-8309-44ef-9b57-03041399ddee. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] Acquiring lock "refresh_cache-f7bd2fd9-b592-45d4-a782-5d5e59452366" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Updating instance_info_cache with network_info: [{"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance destroyed successfully.
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.objects.instance [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'resources' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Releasing lock "refresh_cache-f7bd2fd9-b592-45d4-a782-5d5e59452366" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Instance network_info: |[{"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] Acquired lock "refresh_cache-f7bd2fd9-b592-45d4-a782-5d5e59452366" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Refreshing network info cache for port 360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Start _get_guest_xml network_info=[{"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949739455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949739455',id=30,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ZqviLSokViG2Q1GMcg2v0NA1/0InAjTVojMUxsKDqWU2ZFjY5eQaj/XwReZeMLvlcK3up1KwckNZkxN9ZHxwPiScuEKI1kfjb66N+FAbroZx55XGQ8tn2qE1a/rx6GA==',key_name='tempest-keypair-2111111205',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:33:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-95zxp0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member',shelved_at='2023-10-20T16:35:55.463154',shelved_host='user',shelved_image_id='015e7d74-592c-426d-91f5-3467b1b1b68d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=e30f3de0-f564-4c73-9d9f-7292ceab83b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG os_vif [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing instance network info cache due to event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] Acquiring lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] Acquired lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7757fa8-59, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ff2d666-ba80-4298-bdb2-b1811e8e9658) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: INFO os_vif [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59')
Oct 20 16:35:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Deleting instance files /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1_del
Oct 20 16:35:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Deletion of /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1_del complete
Oct 20 16:35:56 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:56 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-309573290',display_name='tempest-VolumesActionsTest-instance-309573290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-309573290',id=36,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ae0ab6863f4f07a65fbe7bc98e1e24',ramdisk_id='',reservation_id='r-zvzq61bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1417678142',owner_user_name='tempest-VolumesActionsTest-1417678142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:54Z,user_data=None,user_id='920bc059cf2644199effa540a62c07ea',uuid=f7bd2fd9-b592-45d4-a782-5d5e59452366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converting VIF {"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5c:d5,bridge_name='br-int',has_traffic_filtering=True,id=360cfcfa-8309-44ef-9b57-03041399ddee,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360cfcfa-83') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lazy-loading 'pci_devices' on Instance uuid f7bd2fd9-b592-45d4-a782-5d5e59452366 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:35:56 user nova-compute[74131]:   <uuid>f7bd2fd9-b592-45d4-a782-5d5e59452366</uuid>
Oct 20 16:35:56 user nova-compute[74131]:   <name>instance-00000024</name>
Oct 20 16:35:56 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:35:56 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:35:56 user nova-compute[74131]:   <metadata>
Oct 20 16:35:56 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:35:56 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:35:56 user nova-compute[74131]:       <nova:name>tempest-VolumesActionsTest-instance-309573290</nova:name>
Oct 20 16:35:56 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:35:56</nova:creationTime>
Oct 20 16:35:56 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:35:56 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:35:56 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:35:56 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:35:56 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:35:56 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:35:56 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:35:56 user nova-compute[74131]:       <nova:owner>
Oct 20 16:35:56 user nova-compute[74131]:         <nova:user uuid="920bc059cf2644199effa540a62c07ea">tempest-VolumesActionsTest-1417678142-project-member</nova:user>
Oct 20 16:35:56 user nova-compute[74131]:         <nova:project uuid="22ae0ab6863f4f07a65fbe7bc98e1e24">tempest-VolumesActionsTest-1417678142</nova:project>
Oct 20 16:35:56 user nova-compute[74131]:       </nova:owner>
Oct 20 16:35:56 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:35:56 user nova-compute[74131]:       <nova:ports>
Oct 20 16:35:56 user nova-compute[74131]:         <nova:port uuid="360cfcfa-8309-44ef-9b57-03041399ddee">
Oct 20 16:35:56 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 16:35:56 user nova-compute[74131]:         </nova:port>
Oct 20 16:35:56 user nova-compute[74131]:       </nova:ports>
Oct 20 16:35:56 user nova-compute[74131]:     </nova:instance>
Oct 20 16:35:56 user nova-compute[74131]:   </metadata>
Oct 20 16:35:56 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:35:56 user nova-compute[74131]:     <system>
Oct 20 16:35:56 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:35:56 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:35:56 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:35:56 user nova-compute[74131]:       <entry name="serial">f7bd2fd9-b592-45d4-a782-5d5e59452366</entry>
Oct 20 16:35:56 user nova-compute[74131]:       <entry name="uuid">f7bd2fd9-b592-45d4-a782-5d5e59452366</entry>
Oct 20 16:35:56 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:35:56 user nova-compute[74131]:     </system>
Oct 20 16:35:56 user nova-compute[74131]:   </sysinfo>
Oct 20 16:35:56 user nova-compute[74131]:   <os>
Oct 20 16:35:56 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:35:56 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:35:56 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:35:56 user nova-compute[74131]:   </os>
Oct 20 16:35:56 user nova-compute[74131]:   <features>
Oct 20 16:35:56 user nova-compute[74131]:     <acpi/>
Oct 20 16:35:56 user nova-compute[74131]:     <apic/>
Oct 20 16:35:56 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:35:56 user nova-compute[74131]:   </features>
Oct 20 16:35:56 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:35:56 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:35:56 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:35:56 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:35:56 user nova-compute[74131]:   </clock>
Oct 20 16:35:56 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:35:56 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:35:56 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:35:56 user nova-compute[74131]:   </cpu>
Oct 20 16:35:56 user nova-compute[74131]:   <devices>
Oct 20 16:35:56 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:35:56 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:35:56 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk"/>
Oct 20 16:35:56 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:35:56 user nova-compute[74131]:     </disk>
Oct 20 16:35:56 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:35:56 user nova-compute[74131]:       <mac address="fa:16:3e:7d:5c:d5"/>
Oct 20 16:35:56 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:56 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:35:56 user nova-compute[74131]:       <target dev="tap360cfcfa-83"/>
Oct 20 16:35:56 user nova-compute[74131]:     </interface>
Oct 20 16:35:56 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:35:56 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/console.log" append="off"/>
Oct 20 16:35:56 user nova-compute[74131]:     </serial>
Oct 20 16:35:56 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:35:56 user nova-compute[74131]:     <video>
Oct 20 16:35:56 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:35:56 user nova-compute[74131]:     </video>
Oct 20 16:35:56 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:35:56 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:35:56 user nova-compute[74131]:     </rng>
Oct 20 16:35:56 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:35:56 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:35:56 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:35:56 user nova-compute[74131]:     </memballoon>
Oct 20 16:35:56 user nova-compute[74131]:   </devices>
Oct 20 16:35:56 user nova-compute[74131]: </domain>
Oct 20 16:35:56 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-309573290',display_name='tempest-VolumesActionsTest-instance-309573290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-309573290',id=36,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ae0ab6863f4f07a65fbe7bc98e1e24',ramdisk_id='',reservation_id='r-zvzq61bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1417678142',owner_user_name='tempest-VolumesActionsTest-1417678142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:35:54Z,user_data=None,user_id='920bc059cf2644199effa540a62c07ea',uuid=f7bd2fd9-b592-45d4-a782-5d5e59452366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converting VIF {"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5c:d5,bridge_name='br-int',has_traffic_filtering=True,id=360cfcfa-8309-44ef-9b57-03041399ddee,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360cfcfa-83') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG os_vif [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5c:d5,bridge_name='br-int',has_traffic_filtering=True,id=360cfcfa-8309-44ef-9b57-03041399ddee,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360cfcfa-83') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6be8ff98-4c2c-53d7-bb51-5928e03c8120', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap360cfcfa-83, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap360cfcfa-83, col_values=(('qos', UUID('cf909ee0-4869-49b4-b7dd-ca58a03f9ebf')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap360cfcfa-83, col_values=(('external_ids', {'iface-id': '360cfcfa-8309-44ef-9b57-03041399ddee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:5c:d5', 'vm-uuid': 'f7bd2fd9-b592-45d4-a782-5d5e59452366'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:56 user nova-compute[74131]: INFO os_vif [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5c:d5,bridge_name='br-int',has_traffic_filtering=True,id=360cfcfa-8309-44ef-9b57-03041399ddee,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360cfcfa-83')
Oct 20 16:35:56 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Deleted allocations for instance e30f3de0-f564-4c73-9d9f-7292ceab83b1
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] No VIF found with MAC fa:16:3e:7d:5c:d5, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.objects.instance [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'numa_topology' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:35:56 user nova-compute[74131]: DEBUG nova.objects.base [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<e30f3de0-f564-4c73-9d9f-7292ceab83b1> lazy-loaded attributes: resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updated VIF entry in instance network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa7757fa8-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9654a37f-3d78-473f-97da-9fe6e992f657 req-84786cce-cf1b-482b-9259-150c446baa2a service nova] Releasing lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-513f8fe8-3164-43b4-b45a-af55cf36201d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.059s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Updated VIF entry in instance network info cache for port 360cfcfa-8309-44ef-9b57-03041399ddee. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG nova.network.neutron [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Updating instance_info_cache with network_info: [{"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:35:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e6aef0d1-5946-4453-a5f7-96c9eacb399a req-0c786406-7379-4393-b613-e359754a0330 service nova] Releasing lock "refresh_cache-f7bd2fd9-b592-45d4-a782-5d5e59452366" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-3d5fc65f-3147-4a4e-832d-03e9decd36ab req-5d2229c7-15e1-40fa-867b-97804ccaa775 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received event network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d5fc65f-3147-4a4e-832d-03e9decd36ab req-5d2229c7-15e1-40fa-867b-97804ccaa775 service nova] Acquiring lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d5fc65f-3147-4a4e-832d-03e9decd36ab req-5d2229c7-15e1-40fa-867b-97804ccaa775 service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d5fc65f-3147-4a4e-832d-03e9decd36ab req-5d2229c7-15e1-40fa-867b-97804ccaa775 service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-3d5fc65f-3147-4a4e-832d-03e9decd36ab req-5d2229c7-15e1-40fa-867b-97804ccaa775 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] No waiting events found dispatching network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:35:58 user nova-compute[74131]: WARNING nova.compute.manager [req-3d5fc65f-3147-4a4e-832d-03e9decd36ab req-5d2229c7-15e1-40fa-867b-97804ccaa775 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received unexpected event network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee for instance with vm_state building and task_state spawning.
Oct 20 16:35:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:35:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:36:00 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Instance spawned successfully.
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:36:00 user nova-compute[74131]: INFO nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-ec9ce72d-6fc2-4360-b8e0-3f9a73dd66e0 req-95ee00cc-38a8-42db-844d-953551ce14aa service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received event network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ec9ce72d-6fc2-4360-b8e0-3f9a73dd66e0 req-95ee00cc-38a8-42db-844d-953551ce14aa service nova] Acquiring lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ec9ce72d-6fc2-4360-b8e0-3f9a73dd66e0 req-95ee00cc-38a8-42db-844d-953551ce14aa service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ec9ce72d-6fc2-4360-b8e0-3f9a73dd66e0 req-95ee00cc-38a8-42db-844d-953551ce14aa service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-ec9ce72d-6fc2-4360-b8e0-3f9a73dd66e0 req-95ee00cc-38a8-42db-844d-953551ce14aa service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] No waiting events found dispatching network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:00 user nova-compute[74131]: WARNING nova.compute.manager [req-ec9ce72d-6fc2-4360-b8e0-3f9a73dd66e0 req-95ee00cc-38a8-42db-844d-953551ce14aa service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received unexpected event network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee for instance with vm_state building and task_state spawning.
Oct 20 16:36:00 user nova-compute[74131]: INFO nova.compute.manager [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Took 6.95 seconds to build instance.
Oct 20 16:36:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a5f46c3-1b25-49c3-9fcc-8fd85dab874f tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.067s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:36:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:36:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:32 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:36:32 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7135MB free_disk=24.950157165527344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 7146dad8-b7e6-4d2f-9774-148d3ddda54e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance ab235c2a-ffaa-47c5-87ec-ce03b4129cdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f7bd2fd9-b592-45d4-a782-5d5e59452366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:36:32 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-changed-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Refreshing instance network info cache due to event network-changed-d07acc65-5b76-49a6-a0c3-b1b633018b89. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] Acquiring lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] Acquired lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.network.neutron [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Refreshing network info cache for port d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.network.neutron [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Updated VIF entry in instance network info cache for port d07acc65-5b76-49a6-a0c3-b1b633018b89. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.network.neutron [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Updating instance_info_cache with network_info: [{"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b8860999-0f3c-4194-b070-624106253031 req-2dc45e19-81ef-415e-8da0-b6c61abf9d7b service nova] Releasing lock "refresh_cache-ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:33 user nova-compute[74131]: INFO nova.compute.manager [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Terminating instance
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-f77746b4-3aef-4f6d-b7ba-c1fa2737de94 req-fa9fce38-1cdc-4960-81e9-733986fef8a1 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-unplugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f77746b4-3aef-4f6d-b7ba-c1fa2737de94 req-fa9fce38-1cdc-4960-81e9-733986fef8a1 service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f77746b4-3aef-4f6d-b7ba-c1fa2737de94 req-fa9fce38-1cdc-4960-81e9-733986fef8a1 service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f77746b4-3aef-4f6d-b7ba-c1fa2737de94 req-fa9fce38-1cdc-4960-81e9-733986fef8a1 service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-f77746b4-3aef-4f6d-b7ba-c1fa2737de94 req-fa9fce38-1cdc-4960-81e9-733986fef8a1 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-unplugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-f77746b4-3aef-4f6d-b7ba-c1fa2737de94 req-fa9fce38-1cdc-4960-81e9-733986fef8a1 service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-unplugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Instance destroyed successfully.
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'resources' on Instance uuid ab235c2a-ffaa-47c5-87ec-ce03b4129cdd {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-806424546',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-806424546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-806424546',id=31,image_ref='89ecf50d-886f-42cf-bff0-5af96f8b7a82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvJUv33ykn1ddmIbtFHyv18KlkpPtSSi48B9ftL+03PX0KlomjXgJitY25qisZXwrWgQf4GWn5nCufsUZ2E8uGjFppCnq1HwM73JhuxQMQt/Yxsp2ptMdZJ3aolRRKTdA==',key_name='tempest-keypair-1202049707',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-ouj96dma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-978997028',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=ab235c2a-ffaa-47c5-87ec-ce03b4129cdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "address": "fa:16:3e:e6:95:3b", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07acc65-5b", "ovs_interfaceid": "d07acc65-5b76-49a6-a0c3-b1b633018b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:95:3b,bridge_name='br-int',has_traffic_filtering=True,id=d07acc65-5b76-49a6-a0c3-b1b633018b89,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07acc65-5b') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_vif [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:95:3b,bridge_name='br-int',has_traffic_filtering=True,id=d07acc65-5b76-49a6-a0c3-b1b633018b89,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07acc65-5b') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd07acc65-5b, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a8dcd74-f129-47e0-bfab-fcba909c55fc) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: INFO os_vif [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:95:3b,bridge_name='br-int',has_traffic_filtering=True,id=d07acc65-5b76-49a6-a0c3-b1b633018b89,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07acc65-5b')
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQhZBfJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:36:34 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f65bb4-2ecd-43d8-b597-2e153dd01832]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:36:34 user nova-compute[74131]: No targets found.
Oct 20 16:36:34 user nova-compute[74131]: iSNS:
Oct 20 16:36:34 user nova-compute[74131]: No targets found.
Oct 20 16:36:34 user nova-compute[74131]: STATIC:
Oct 20 16:36:34 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf
Oct 20 16:36:34 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:36:34 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:36:34 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01
Oct 20 16:36:34 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:36:34 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:36:34 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:36:34 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:36:34 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:36:34 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:36:34 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:36:34 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:36:34 user nova-compute[74131]: FIRMWARE:
Oct 20 16:36:34 user nova-compute[74131]: No targets found.
Oct 20 16:36:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:36:34 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:36:34 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e684a2-1482-4bac-8139-b70f911370c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6e1a8-4b3b-49b3-b8f3-631dd31ad79d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:36:34 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:36:34 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:36:34 user nova-compute[74131]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:36:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:36:34 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:36:34 user nova-compute[74131]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf (non-flash)
Oct 20 16:36:34 user nova-compute[74131]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:36:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c840e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d568c319-fab5-4232-92a9-c96627d780db]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f872f-d6c8-4f21-b9b7-1f8d74a695de]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3877d4e8-34b2-46a8-9092-2572c86697cc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0986d9-e384-42ef-9134-0998aa5eb942]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_515cd4d7', '/dev/disk/by-id/scsi-1SCST_BIO515cd4d7-e6fd24feaf84334c', '/dev/disk/by-id/scsi-26536666432346665') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:36:34 user nova-compute[74131]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_515cd4d7
Oct 20 16:36:34 user nova-compute[74131]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO515cd4d7-e6fd24feaf84334c
Oct 20 16:36:34 user nova-compute[74131]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26536666432346665
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ad030-e837-423b-a838-47b3e270394c]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a5478-59aa-449c-9512-93217fcedc04]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2054427-3876-4a8a-96c0-45b4041a3f50]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260]
Oct 20 16:36:34 user nova-compute[74131]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf, portal: 172.16.0.220,3260] successful.
Oct 20 16:36:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2457c0-7ca3-4aec-8b30-cddbe484dccf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfcf018-3949-4e53-919f-d96901391f99]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== disconnect_volume: return (378ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:36:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Deleting instance files /opt/stack/data/nova/instances/ab235c2a-ffaa-47c5-87ec-ce03b4129cdd_del
Oct 20 16:36:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Deletion of /opt/stack/data/nova/instances/ab235c2a-ffaa-47c5-87ec-ce03b4129cdd_del complete
Oct 20 16:36:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:34 user nova-compute[74131]: INFO nova.compute.manager [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 20 16:36:34 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:36:34 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating instance_info_cache with network_info: [{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:36:35 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:36:35 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Took 0.68 seconds to deallocate network for instance.
Oct 20 16:36:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-defe94a6-71d8-455a-9375-9d1d967691ce req-44ed7245-271c-4c3c-9bc9-68fc2e3cf54b service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-deleted-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:36 user nova-compute[74131]: WARNING nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received unexpected event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with vm_state active and task_state deleting.
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:36 user nova-compute[74131]: WARNING nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received unexpected event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with vm_state active and task_state deleting.
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:36 user nova-compute[74131]: WARNING nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received unexpected event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with vm_state active and task_state deleting.
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-unplugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-unplugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-unplugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Acquiring lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] No waiting events found dispatching network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:36 user nova-compute[74131]: WARNING nova.compute.manager [req-60d35202-fcaf-47d3-ac14-74e749fec17e req-291df7ee-8f5b-42c7-a584-3463267fc75f service nova] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Received unexpected event network-vif-plugged-d07acc65-5b76-49a6-a0c3-b1b633018b89 for instance with vm_state active and task_state deleting.
Oct 20 16:36:36 user nova-compute[74131]: INFO nova.compute.manager [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Took 0.79 seconds to detach 1 volumes for instance.
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: ab235c2a-ffaa-47c5-87ec-ce03b4129cdd] Deleting volume: 8c2457c0-7ca3-4aec-8b30-cddbe484dccf {{(pid=74131) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:36:36 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:36:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:37 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Deleted allocations for instance ab235c2a-ffaa-47c5-87ec-ce03b4129cdd
Oct 20 16:36:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a211ec6e-77c6-4b47-bcc6-f2462917bd75 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "ab235c2a-ffaa-47c5-87ec-ce03b4129cdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.430s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing instance network info cache due to event network-changed-ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] Acquiring lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] Acquired lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Refreshing network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:42 user nova-compute[74131]: INFO nova.compute.manager [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Terminating instance
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updated VIF entry in instance network info cache for port ddc3a20a-cba1-478b-8092-212e8242efdd. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [{"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-502ef07b-4591-4520-b328-c235f488ee76 req-bba68c18-4482-48d1-adee-bc1d23e3c0e2 service nova] Releasing lock "refresh_cache-2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-changed-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Refreshing instance network info cache due to event network-changed-b11180ef-e4ce-449e-8b4c-4aab6be3ff20. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] Acquiring lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] Acquired lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Refreshing network info cache for port b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:36:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Instance destroyed successfully.
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.objects.instance [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lazy-loading 'resources' on Instance uuid 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1869711731',display_name='tempest-TestShelveInstance-server-1869711731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1869711731',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUJpKZ7EF3pMBcrZ8jN++RFwR8/CxEsDEstxbf+PP7z88HzQyANnHT228yzGCjshrKUPfLDZYwDuLx2aj5JTr07Q3kCISI9l9+7xCssaO1K13yoCfNczcpyUYs2bDCieg==',key_name='tempest-TestShelveInstance-1849926161',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92ce29bcf6e2431a92d345a3e739f81e',ramdisk_id='',reservation_id='r-t8xnfbd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1948790584',owner_user_name='tempest-TestShelveInstance-1948790584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:35:31Z,user_data=None,user_id='059cd89b482d4205a8d7f5a32037afd9',uuid=2c80c4b9-4ab7-45e1-aca6-2bef81ffb635,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converting VIF {"id": "ddc3a20a-cba1-478b-8092-212e8242efdd", "address": "fa:16:3e:05:02:41", "network": {"id": "a5195c79-9301-4034-a295-c15da088a151", "bridge": "br-int", "label": "tempest-TestShelveInstance-2029244079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ce29bcf6e2431a92d345a3e739f81e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3a20a-cb", "ovs_interfaceid": "ddc3a20a-cba1-478b-8092-212e8242efdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG os_vif [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddc3a20a-cb, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:36:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b83cb63a-3d51-4106-a2b8-9fd0e0d4e9e8) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:43 user nova-compute[74131]: INFO os_vif [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:02:41,bridge_name='br-int',has_traffic_filtering=True,id=ddc3a20a-cba1-478b-8092-212e8242efdd,network=Network(a5195c79-9301-4034-a295-c15da088a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3a20a-cb')
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJgeZKDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:36:43 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.120s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c98c7a-185c-43f9-96a2-4da4c896955a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:36:43 user nova-compute[74131]: No targets found.
Oct 20 16:36:43 user nova-compute[74131]: iSNS:
Oct 20 16:36:43 user nova-compute[74131]: No targets found.
Oct 20 16:36:43 user nova-compute[74131]: STATIC:
Oct 20 16:36:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01
Oct 20 16:36:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:36:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:36:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:36:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:36:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:36:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:36:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:36:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:36:43 user nova-compute[74131]: FIRMWARE:
Oct 20 16:36:43 user nova-compute[74131]: No targets found.
Oct 20 16:36:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:36:43 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:36:43 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc367a4-9411-4778-8ef4-93d84c132232]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e64615-1654-4ab6-9783-ed63d5b458f9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:36:43 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:36:43 user nova-compute[74131]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:36:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:36:43 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:36:43 user nova-compute[74131]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 (non-flash)
Oct 20 16:36:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c86a3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01'): ({'sde'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Removing single pathed devices sde {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[be95081e-a21c-4613-ac44-3c32ebcfbc1b]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2c8b8-31c5-428b-b20e-65c8bf9fb179]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Flushing IO for device /dev/sde {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0a19e9-3c87-403c-a7db-cd2ae5cf948b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3fa4c1-9ab0-462c-abf4-faa1f11db9ad]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23138326364633030', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_976ffcd3', '/dev/disk/by-id/scsi-1SCST_BIO976ffcd3-182cdc006e8e20b8') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a519d6f6-dfe2-4564-8627-ccdb03ef422e]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fefd37-9759-4ea4-b3ff-e116fc00c7e0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b853f3e5-1559-46ce-b9d7-90aa3f3589d5]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260]
Oct 20 16:36:43 user nova-compute[74131]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01, portal: 172.16.0.220,3260] successful.
Oct 20 16:36:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67480b9d-ee42-44ae-bb15-41c5ecb1dc01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[21feee8d-5e5e-4f74-9a69-8d6a1f5f13d1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] <== disconnect_volume: return (450ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:36:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Deleting instance files /opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635_del
Oct 20 16:36:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Deletion of /opt/stack/data/nova/instances/2c80c4b9-4ab7-45e1-aca6-2bef81ffb635_del complete
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'flavor' on Instance uuid cee5222c-c297-4c9b-9eab-9f3b48d441b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:36:43 user nova-compute[74131]: INFO nova.compute.manager [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updated VIF entry in instance network info cache for port b11180ef-e4ce-449e-8b4c-4aab6be3ff20. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updating instance_info_cache with network_info: [{"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d812cc56-0866-49f1-a4b9-fc4eeb6010de req-2139bc4c-dac4-4adf-a65d-d0efd357dc11 service nova] Releasing lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:43 user nova-compute[74131]: INFO nova.compute.manager [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Attaching volume 9406517b-e98c-4c4a-b926-93d46f5619a5 to /dev/vdb
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.utils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[36235e56-3bf5-4d4f-ba44-6a0c457e1e8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c4044-0004-48a3-b738-146307310bb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[253026a3-df1d-4f5e-ab95-fb17752e2ff9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a7b09f-c321-47b2-83ce-c8455659fe37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:36:43 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:36:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad12533-20b0-4ccd-b0a4-261dfc0fd044]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG os_brick.utils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:36:43 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updating existing volume attachment record: f1075a93-839b-4022-bcf8-71e30615141e {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-unplugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-unplugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-unplugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] Acquiring lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] No waiting events found dispatching network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:36:44 user nova-compute[74131]: WARNING nova.compute.manager [req-a290fd2a-6ccd-4816-9bed-52ca791605ed req-02237147-e658-4deb-8979-e573de716a19 service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received unexpected event network-vif-plugged-ddc3a20a-cba1-478b-8092-212e8242efdd for instance with vm_state active and task_state deleting.
Oct 20 16:36:44 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:36:44 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Took 0.57 seconds to deallocate network for instance.
Oct 20 16:36:44 user nova-compute[74131]: INFO nova.compute.manager [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Took 0.85 seconds to detach 1 volumes for instance.
Oct 20 16:36:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Deleting volume: 67480b9d-ee42-44ae-bb15-41c5ecb1dc01 {{(pid=74131) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 16:36:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:36:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:36:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:45 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:36:45 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:36:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:45 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Deleted allocations for instance 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635
Oct 20 16:36:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9568d815-58c3-420f-9675-1dbe607ac7bc tempest-TestShelveInstance-1948790584 tempest-TestShelveInstance-1948790584-project-member] Lock "2c80c4b9-4ab7-45e1-aca6-2bef81ffb635" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.553s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:36:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-f179691a-361d-4fba-b6b4-d51f43dd2e35 req-5cc1972a-b1e5-4d4c-9c5d-a18fdc0d1fbc service nova] [instance: 2c80c4b9-4ab7-45e1-aca6-2bef81ffb635] Received event network-vif-deleted-ddc3a20a-cba1-478b-8092-212e8242efdd {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-changed-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Refreshing instance network info cache due to event network-changed-f5e64e14-ac02-4600-ac9b-9fa85e263786. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Refreshing network info cache for port f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updated VIF entry in instance network info cache for port f5e64e14-ac02-4600-ac9b-9fa85e263786. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:36:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e982671-f5ee-4d92-aed3-06cc4451de9a req-914376b2-89b3-4a26-9f14-f90a2be4c820 service nova] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:36:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siEzvcta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:37:00 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:37:00 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:37:00 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8c1e1e-be1f-466e-9dcc-facd94086834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:37:00 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc314c6-8222-4d32-a705-d0e3ea62c89f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5] added
Oct 20 16:37:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e105dff-7d41-493e-b5f2-eb4a9bb474c9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5f4e02-7946-450e-883e-58ee9bc47b7d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siEzvcta {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siEzvcta" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f052bde2-299a-487c-bb9c-1411ae473a13]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'siEzvcta'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4e6d5-48b0-4c5b-9f82-855b8803b002]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcfb05d-3216-414d-bd56-9b46645f12e9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68b16b2-c3ea-46a6-a2a3-ce3985447253]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260]
Oct 20 16:37:01 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260] successful.
Oct 20 16:37:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d46369b-2136-49a7-85da-e3d2aac69efb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed7e46-6182-42f9-b467-d0cf5ab68063]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:01 user nova-compute[74131]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 (non-flash)
Oct 20 16:37:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:01 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:01 user nova-compute[74131]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 (non-flash)
Oct 20 16:37:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebaee75-b233-4ea1-83bb-480b608b1274]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:37:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siEzvcta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23430303066383132', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430303066383132', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG nova.objects.instance [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'flavor' on Instance uuid cee5222c-c297-4c9b-9eab-9f3b48d441b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:37:02 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:37:02 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:37:02 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:37:02 user nova-compute[74131]:   <serial>9406517b-e98c-4c4a-b926-93d46f5619a5</serial>
Oct 20 16:37:02 user nova-compute[74131]: </disk>
Oct 20 16:37:02 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] No VIF found with MAC fa:16:3e:c7:06:f1, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:37:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-154c0491-cf5a-4d50-a57d-3cd2a03f04bf tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.013s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:04 user nova-compute[74131]: INFO nova.compute.manager [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Detaching volume 9406517b-e98c-4c4a-b926-93d46f5619a5
Oct 20 16:37:04 user nova-compute[74131]: INFO nova.virt.block_device [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Attempting to driver detach volume 9406517b-e98c-4c4a-b926-93d46f5619a5 from mountpoint /dev/vdb
Oct 20 16:37:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Attempting to detach device vdb from instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:37:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:37:04 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:37:04 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:37:04 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:37:04 user nova-compute[74131]:   <serial>9406517b-e98c-4c4a-b926-93d46f5619a5</serial>
Oct 20 16:37:04 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:37:04 user nova-compute[74131]: </disk>
Oct 20 16:37:04 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:37:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully detached device vdb from instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 from the persistent domain config.
Oct 20 16:37:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:37:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:37:04 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:37:04 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:37:04 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:37:04 user nova-compute[74131]:   <serial>9406517b-e98c-4c4a-b926-93d46f5619a5</serial>
Oct 20 16:37:04 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:37:04 user nova-compute[74131]: </disk>
Oct 20 16:37:04 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:37:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:37:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:37:17 user nova-compute[74131]: INFO nova.compute.manager [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] instance snapshotting
Oct 20 16:37:17 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Beginning live snapshot process
Oct 20 16:37:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json -f qcow2 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.167s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdqitxknh/d666c35ad2704ca9a6ee1251cec2fcf8.delta 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdqitxknh/d666c35ad2704ca9a6ee1251cec2fcf8.delta 1073741824" returned: 0 in 0.047s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 16:37:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:37:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74131) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 16:37:19 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 16:37:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:19 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:37:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdqitxknh/d666c35ad2704ca9a6ee1251cec2fcf8.delta /opt/stack/data/nova/instances/snapshots/tmpdqitxknh/d666c35ad2704ca9a6ee1251cec2fcf8 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdqitxknh/d666c35ad2704ca9a6ee1251cec2fcf8.delta /opt/stack/data/nova/instances/snapshots/tmpdqitxknh/d666c35ad2704ca9a6ee1251cec2fcf8" returned: 0 in 0.452s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Snapshot extracted, beginning image upload
Oct 20 16:37:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Snapshot image upload complete
Oct 20 16:37:22 user nova-compute[74131]: INFO nova.compute.manager [None req-11fbb73e-ecc6-4c89-8292-6791ca74bf0f tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Took 5.20 seconds to snapshot the instance on the hypervisor.
Oct 20 16:37:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:37:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-changed-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Refreshing instance network info cache due to event network-changed-334ce2d7-c655-430b-8c98-25c37e643e6a. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:37:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] Acquiring lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:37:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] Acquired lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:37:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Refreshing network info cache for port 334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:37:24 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 is timed out.
Oct 20 16:37:24 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully detached device vdb from instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 from the live domain config.
Oct 20 16:37:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siEzvcta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:37:24 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[69665446-f96c-40b8-b55f-8ae02c9fe354]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:37:24 user nova-compute[74131]: No targets found.
Oct 20 16:37:24 user nova-compute[74131]: iSNS:
Oct 20 16:37:24 user nova-compute[74131]: No targets found.
Oct 20 16:37:24 user nova-compute[74131]: STATIC:
Oct 20 16:37:24 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5
Oct 20 16:37:24 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:37:24 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:37:24 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:37:24 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:37:24 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:37:24 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:37:24 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:37:24 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:37:24 user nova-compute[74131]: FIRMWARE:
Oct 20 16:37:24 user nova-compute[74131]: No targets found.
Oct 20 16:37:24 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:37:24 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:37:24 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updated VIF entry in instance network info cache for port 334ce2d7-c655-430b-8c98-25c37e643e6a. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da92f0c-1d10-4513-81e0-8bdb224ef07d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4a00900e-2a4d-4ad5-8a87-a71ca256b601 req-405e0840-1395-434f-85f5-8cfd5f7c3806 service nova] Releasing lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2e57b-92b3-402e-ac30-fa1fa8ce706a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:24 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:24 user nova-compute[74131]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 (non-flash)
Oct 20 16:37:24 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:24 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:24 user nova-compute[74131]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 (non-flash)
Oct 20 16:37:24 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87728c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[66604d16-da67-446c-bf5a-34f7664af9c3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872322f-5655-4e1a-a48b-82f1db43f4c2]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[230dce79-60b6-4933-a818-eeb187b2c9a9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:37:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d84bf-7072-4ba0-ad5a-ad7a7960e088]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa47d8cd-e2a7-47a2-a372-c9c76f1d1cdf]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e283612-0c48-4243-a7cd-0724665f01e5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260]
Oct 20 16:37:25 user nova-compute[74131]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5, portal: 172.16.0.220,3260] successful.
Oct 20 16:37:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9406517b-e98c-4c4a-b926-93d46f5619a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2827b3-e6d8-459b-bb22-002d833fde87]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] <== disconnect_volume: return (348ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:26 user nova-compute[74131]: DEBUG nova.objects.instance [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'flavor' on Instance uuid cee5222c-c297-4c9b-9eab-9f3b48d441b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-50ec207d-0822-4f0b-978a-44e12030b166 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:29 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:29 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG nova.objects.instance [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:30 user nova-compute[74131]: INFO nova.compute.manager [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Attaching volume 843400db-b249-47fd-ac36-0396f0a933cf to /dev/vdb
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG os_brick.utils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f2c11f-278f-414f-bcc7-e15476321578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b93a7a-ac7b-465c-a628-b49417b6145c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557d95c-66ac-499d-b838-1ad5e21a0943]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0404ba-9afd-42bd-9f0f-c4bd417cab6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:37:30 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe9c21f-ab12-4fec-a166-1748f6caf691]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG os_brick.utils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating existing volume attachment record: f6ff6ee7-6cca-4aa4-bc91-b787ec6a606e {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:33 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:37:33 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:37:33 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=24.873897552490234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:37:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 7146dad8-b7e6-4d2f-9774-148d3ddda54e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f7bd2fd9-b592-45d4-a782-5d5e59452366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:34 user nova-compute[74131]: INFO nova.compute.manager [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Terminating instance
Oct 20 16:37:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-10ab107e-d228-4999-9e54-94a596107b6d req-3d476f27-13c0-4f9d-b3ad-c0481401aa12 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-vif-unplugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-10ab107e-d228-4999-9e54-94a596107b6d req-3d476f27-13c0-4f9d-b3ad-c0481401aa12 service nova] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-10ab107e-d228-4999-9e54-94a596107b6d req-3d476f27-13c0-4f9d-b3ad-c0481401aa12 service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-10ab107e-d228-4999-9e54-94a596107b6d req-3d476f27-13c0-4f9d-b3ad-c0481401aa12 service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-10ab107e-d228-4999-9e54-94a596107b6d req-3d476f27-13c0-4f9d-b3ad-c0481401aa12 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] No waiting events found dispatching network-vif-unplugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-10ab107e-d228-4999-9e54-94a596107b6d req-3d476f27-13c0-4f9d-b3ad-c0481401aa12 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-vif-unplugged-02c962b1-cd04-4515-9995-ede3554c6f07 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Instance destroyed successfully.
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.objects.instance [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'resources' on Instance uuid 7146dad8-b7e6-4d2f-9774-148d3ddda54e {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1931189949',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1931189949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1931189949',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7FU1yXKJDnPDiSPVp1byP7mCUYNa8M9mLImbNVSQ4XNnKychqEJQFdDo42KM+8DR/45scx0sE+LjvLYulCx1zckqvcKD/pNB3qin9QePV8U+UjNDfCwYaYVEnSFS6dpQ==',key_name='tempest-keypair-996504905',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:33:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-w08f5a2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:33:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=7146dad8-b7e6-4d2f-9774-148d3ddda54e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "02c962b1-cd04-4515-9995-ede3554c6f07", "address": "fa:16:3e:7d:68:a0", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c962b1-cd", "ovs_interfaceid": "02c962b1-cd04-4515-9995-ede3554c6f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:68:a0,bridge_name='br-int',has_traffic_filtering=True,id=02c962b1-cd04-4515-9995-ede3554c6f07,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c962b1-cd') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_vif [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:68:a0,bridge_name='br-int',has_traffic_filtering=True,id=02c962b1-cd04-4515-9995-ede3554c6f07,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c962b1-cd') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02c962b1-cd, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86bd0aa1-8b7f-4f96-a140-d6ef9032792c) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:35 user nova-compute[74131]: INFO os_vif [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:68:a0,bridge_name='br-int',has_traffic_filtering=True,id=02c962b1-cd04-4515-9995-ede3554c6f07,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c962b1-cd')
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhwOJxoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:37:35 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b66253-7007-478a-807d-36a774a27878]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:37:35 user nova-compute[74131]: No targets found.
Oct 20 16:37:35 user nova-compute[74131]: iSNS:
Oct 20 16:37:35 user nova-compute[74131]: No targets found.
Oct 20 16:37:35 user nova-compute[74131]: STATIC:
Oct 20 16:37:35 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070
Oct 20 16:37:35 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:37:35 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:37:35 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:37:35 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:37:35 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:37:35 user nova-compute[74131]: FIRMWARE:
Oct 20 16:37:35 user nova-compute[74131]: No targets found.
Oct 20 16:37:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:37:35 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:37:35 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf77ad-e01b-4883-a670-c5f4590253fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df80398-febb-4cad-94e1-b727f43eceeb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:35 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:35 user nova-compute[74131]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 (non-flash)
Oct 20 16:37:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c81f29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070'): ({'sdd'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Removing single pathed devices sdd {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3056879-cfa8-44dd-90c1-333e4602fc68]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc2183-c94d-4f8b-ad9e-9add57e50271]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flushing IO for device /dev/sdd {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147c731-f24a-49d3-ba35-d37ba17b5616]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.070s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a855c0-699f-4687-a2f1-395f34f31943]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3309a45-312d-4c28-a6f4-f68fde64f918]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3646c7fe-29f7-429e-8c84-b7642a7c5a0a]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260]
Oct 20 16:37:36 user nova-compute[74131]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070, portal: 172.16.0.220,3260] successful.
Oct 20 16:37:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a36ee8-2b74-44d4-9096-f43fa2aa6070 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a80000e-df08-454f-86d5-e356bd593209]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== disconnect_volume: return (401ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:37:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Deleting instance files /opt/stack/data/nova/instances/7146dad8-b7e6-4d2f-9774-148d3ddda54e_del
Oct 20 16:37:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Deletion of /opt/stack/data/nova/instances/7146dad8-b7e6-4d2f-9774-148d3ddda54e_del complete
Oct 20 16:37:36 user nova-compute[74131]: INFO nova.compute.manager [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updating instance_info_cache with network_info: [{"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:37:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:37:37 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:37 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Took 1.05 seconds to deallocate network for instance.
Oct 20 16:37:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-99487adf-99a6-46bc-ad85-b83b64777343 req-4aac908c-12cf-44d2-8066-068777a98b14 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-vif-deleted-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-de31b279-ed02-41a5-9aa3-64051b50272f req-98f12b2e-3de5-4890-9b77-1f7803a82b32 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received event network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de31b279-ed02-41a5-9aa3-64051b50272f req-98f12b2e-3de5-4890-9b77-1f7803a82b32 service nova] Acquiring lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de31b279-ed02-41a5-9aa3-64051b50272f req-98f12b2e-3de5-4890-9b77-1f7803a82b32 service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de31b279-ed02-41a5-9aa3-64051b50272f req-98f12b2e-3de5-4890-9b77-1f7803a82b32 service nova] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-de31b279-ed02-41a5-9aa3-64051b50272f req-98f12b2e-3de5-4890-9b77-1f7803a82b32 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] No waiting events found dispatching network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:37 user nova-compute[74131]: WARNING nova.compute.manager [req-de31b279-ed02-41a5-9aa3-64051b50272f req-98f12b2e-3de5-4890-9b77-1f7803a82b32 service nova] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Received unexpected event network-vif-plugged-02c962b1-cd04-4515-9995-ede3554c6f07 for instance with vm_state active and task_state deleting.
Oct 20 16:37:39 user nova-compute[74131]: INFO nova.compute.manager [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Took 2.48 seconds to detach 1 volumes for instance.
Oct 20 16:37:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 7146dad8-b7e6-4d2f-9774-148d3ddda54e] Deleting volume: 84a36ee8-2b74-44d4-9096-f43fa2aa6070 {{(pid=74131) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 16:37:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:40 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:37:40 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:37:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:40 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Deleted allocations for instance 7146dad8-b7e6-4d2f-9774-148d3ddda54e
Oct 20 16:37:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-051f159a-9ec2-45be-b948-aaf625713265 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "7146dad8-b7e6-4d2f-9774-148d3ddda54e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.613s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:43 user nova-compute[74131]: INFO nova.compute.manager [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Unshelving
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'pci_requests' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'numa_topology' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:37:43 user nova-compute[74131]: INFO nova.compute.claims [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Claim successful on node user
Oct 20 16:37:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.452s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:37:43 user nova-compute[74131]: INFO nova.compute.claims [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Claim successful on node user
Oct 20 16:37:43 user nova-compute[74131]: INFO nova.network.neutron [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "f7bd2fd9-b592-45d4-a782-5d5e59452366" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:37:44 user nova-compute[74131]: INFO nova.compute.manager [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Terminating instance
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.policy [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f6bff83a2e24a289333823acf911ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db8a4e064f445abd0a8555aaa18b88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:37:44 user nova-compute[74131]: INFO nova.virt.block_device [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Booting with volume 40281c46-e7a9-4cf0-af38-f885962d82c2 at /dev/vda
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-04932e91-812f-49b9-a85a-bb88a6a18d2e req-04b372f1-04ca-4ba5-807c-6cf02f60ae47 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received event network-vif-unplugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-04932e91-812f-49b9-a85a-bb88a6a18d2e req-04b372f1-04ca-4ba5-807c-6cf02f60ae47 service nova] Acquiring lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-04932e91-812f-49b9-a85a-bb88a6a18d2e req-04b372f1-04ca-4ba5-807c-6cf02f60ae47 service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-04932e91-812f-49b9-a85a-bb88a6a18d2e req-04b372f1-04ca-4ba5-807c-6cf02f60ae47 service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-04932e91-812f-49b9-a85a-bb88a6a18d2e req-04b372f1-04ca-4ba5-807c-6cf02f60ae47 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] No waiting events found dispatching network-vif-unplugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-04932e91-812f-49b9-a85a-bb88a6a18d2e req-04b372f1-04ca-4ba5-807c-6cf02f60ae47 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received event network-vif-unplugged-360cfcfa-8309-44ef-9b57-03041399ddee for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG os_brick.utils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d2ae7-d0a0-448d-b04c-b2ec2318d915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3adc32-49e0-4487-bcbd-6bcf798ca0b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60787e4-6107-4f0b-b3d2-d072534b651e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e01a4a-43f8-41e9-9ce5-ab665601b129]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:37:44 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:37:44 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[44703c68-993a-4aca-ad7e-1f4d6a37b699]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG os_brick.utils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:37:44 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating existing volume attachment record: 306122a9-8923-486e-858b-147fbf38c9bd {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:37:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Instance destroyed successfully.
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lazy-loading 'resources' on Instance uuid f7bd2fd9-b592-45d4-a782-5d5e59452366 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquired lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-309573290',display_name='tempest-VolumesActionsTest-instance-309573290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-309573290',id=36,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22ae0ab6863f4f07a65fbe7bc98e1e24',ramdisk_id='',reservation_id='r-zvzq61bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1417678142',owner_user_name='tempest-VolumesActionsTest-1417678142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:36:01Z,user_data=None,user_id='920bc059cf2644199effa540a62c07ea',uuid=f7bd2fd9-b592-45d4-a782-5d5e59452366,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converting VIF {"id": "360cfcfa-8309-44ef-9b57-03041399ddee", "address": "fa:16:3e:7d:5c:d5", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360cfcfa-83", "ovs_interfaceid": "360cfcfa-8309-44ef-9b57-03041399ddee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5c:d5,bridge_name='br-int',has_traffic_filtering=True,id=360cfcfa-8309-44ef-9b57-03041399ddee,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360cfcfa-83') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG os_vif [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5c:d5,bridge_name='br-int',has_traffic_filtering=True,id=360cfcfa-8309-44ef-9b57-03041399ddee,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360cfcfa-83') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap360cfcfa-83, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf909ee0-4869-49b4-b7dd-ca58a03f9ebf) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.compute.manager [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing instance network info cache due to event network-changed-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] Acquiring lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:37:45 user nova-compute[74131]: INFO os_vif [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5c:d5,bridge_name='br-int',has_traffic_filtering=True,id=360cfcfa-8309-44ef-9b57-03041399ddee,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360cfcfa-83')
Oct 20 16:37:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Deleting instance files /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366_del
Oct 20 16:37:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Deletion of /opt/stack/data/nova/instances/f7bd2fd9-b592-45d4-a782-5d5e59452366_del complete
Oct 20 16:37:45 user nova-compute[74131]: INFO nova.compute.manager [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Successfully created port: ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Releasing lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:37:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Creating image(s)
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'trusted_certs' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] Acquired lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Refreshing network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.objects.base [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<e30f3de0-f564-4c73-9d9f-7292ceab83b1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "5959b41d4524eb27e8fb5b401d9b22abc7377c6e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "5959b41d4524eb27e8fb5b401d9b22abc7377c6e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:45 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:45 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Took 0.64 seconds to deallocate network for instance.
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Successfully updated port: ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3385e23-9951-42f8-8ee1-3fd20597cac4 req-0148758e-f335-4cc9-b09b-d076de9c4754 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received event network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3385e23-9951-42f8-8ee1-3fd20597cac4 req-0148758e-f335-4cc9-b09b-d076de9c4754 service nova] Acquiring lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3385e23-9951-42f8-8ee1-3fd20597cac4 req-0148758e-f335-4cc9-b09b-d076de9c4754 service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a3385e23-9951-42f8-8ee1-3fd20597cac4 req-0148758e-f335-4cc9-b09b-d076de9c4754 service nova] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3385e23-9951-42f8-8ee1-3fd20597cac4 req-0148758e-f335-4cc9-b09b-d076de9c4754 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] No waiting events found dispatching network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:47 user nova-compute[74131]: WARNING nova.compute.manager [req-a3385e23-9951-42f8-8ee1-3fd20597cac4 req-0148758e-f335-4cc9-b09b-d076de9c4754 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received unexpected event network-vif-plugged-360cfcfa-8309-44ef-9b57-03041399ddee for instance with vm_state deleted and task_state None.
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-a3385e23-9951-42f8-8ee1-3fd20597cac4 req-0148758e-f335-4cc9-b09b-d076de9c4754 service nova] [instance: f7bd2fd9-b592-45d4-a782-5d5e59452366] Received event network-vif-deleted-360cfcfa-8309-44ef-9b57-03041399ddee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-changed-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Refreshing instance network info cache due to event network-changed-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] Acquiring lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] Acquired lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Refreshing network info cache for port ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.part --force-share --output=json" returned: 0 in 0.220s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.virt.images [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] 015e7d74-592c-426d-91f5-3467b1b1b68d was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.part /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6a65645b-3a84-4dad-82ea-c8bc011796ec req-f6c09e89-8fe8-4447-ab91-f2f596f85e9c service nova] Releasing lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquired lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:37:47 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG nova.network.neutron [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updated VIF entry in instance network info cache for port a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG nova.network.neutron [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-16822d4d-b796-4c4d-bdfc-7074d23857f5 req-2f52d684-1a9e-4487-af14-30a5c653713e service nova] Releasing lock "refresh_cache-e30f3de0-f564-4c73-9d9f-7292ceab83b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.part /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.converted" returned: 0 in 0.774s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.044s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:48 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Deleted allocations for instance f7bd2fd9-b592-45d4-a782-5d5e59452366
Oct 20 16:37:48 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Releasing lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance network_info: |[{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "5959b41d4524eb27e8fb5b401d9b22abc7377c6e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.696s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-72d9e9c6-0b56-4b32-9157-2c9f890288ec tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "f7bd2fd9-b592-45d4-a782-5d5e59452366" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.427s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e --force-share --output=json" returned: 0 in 0.213s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "5959b41d4524eb27e8fb5b401d9b22abc7377c6e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "5959b41d4524eb27e8fb5b401d9b22abc7377c6e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e --force-share --output=json" returned: 0 in 0.253s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e,backing_fmt=raw /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e,backing_fmt=raw /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk 1073741824" returned: 0 in 0.070s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "5959b41d4524eb27e8fb5b401d9b22abc7377c6e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'migration_context' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG nova.objects.base [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<e30f3de0-f564-4c73-9d9f-7292ceab83b1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:37:49 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Rebasing disk image.
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e -F raw /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVXJFpHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:37:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:37:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:37:50 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[af288d6a-13ce-4977-9c9e-0e917708f14c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:37:50 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe2bfc2-fb2a-44af-8523-2a91b9fcc6aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf] added
Oct 20 16:37:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e528332-ce48-4fb7-91c8-e44772b11a4a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454e809-7dbe-423b-9cb4-203bbf20b5bd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVXJFpHu {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVXJFpHu" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ead7804-07d1-4a8d-b648-955c5ec5025c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVXJFpHu'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.147s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a9d35-19ef-4337-9c97-709737ed82aa]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[329ac12d-dcce-4f72-86b1-5ab8a94c8962]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ebb0cb-49f2-4157-9c48-8d563e5dfcbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]
Oct 20 16:37:50 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.
Oct 20 16:37:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a862eb-9811-41aa-81f0-6aa96880bb2b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[92226b18-e981-445b-81b8-44500fb0356f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:50 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:37:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:37:50 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:37:50 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75af27a-25c3-4323-9695-44d5a3cfc33a]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:37:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVXJFpHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:37:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:37:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '23862653137663532', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:37:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862653137663532', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:37:51 user nova-compute[74131]: DEBUG nova.objects.instance [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:37:51 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:37:51 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:37:51 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:37:51 user nova-compute[74131]:   <serial>843400db-b249-47fd-ac36-0396f0a933cf</serial>
Oct 20 16:37:51 user nova-compute[74131]: </disk>
Oct 20 16:37:51 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No VIF found with MAC fa:16:3e:28:94:04, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e -F raw /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk" returned: 0 in 3.136s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Ensure instance console log exists: /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Start _get_guest_xml network_info=[{"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='799b1e8cc8b1f44b4ff8cd19eba15a35',container_format='bare',created_at=2023-10-20T16:35:50Z,direct_url=<?>,disk_format='qcow2',id=015e7d74-592c-426d-91f5-3467b1b1b68d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1949739455-shelved',owner='02e81e0cc8c84c22bcb419d79a119364',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T16:35:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:37:52 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:37:52 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='799b1e8cc8b1f44b4ff8cd19eba15a35',container_format='bare',created_at=2023-10-20T16:35:50Z,direct_url=<?>,disk_format='qcow2',id=015e7d74-592c-426d-91f5-3467b1b1b68d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1949739455-shelved',owner='02e81e0cc8c84c22bcb419d79a119364',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T16:35:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'vcpu_model' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.objects.base [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<e30f3de0-f564-4c73-9d9f-7292ceab83b1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949739455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949739455',id=30,image_ref='015e7d74-592c-426d-91f5-3467b1b1b68d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2111111205',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:33:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-95zxp0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member',shelved_at='2023-10-20T16:35:55.463154',shelved_host='user',shelved_image_id='015e7d74-592c-426d-91f5-3467b1b1b68d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=e30f3de0-f564-4c73-9d9f-7292ceab83b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'pci_devices' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.objects.base [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Object Instance<e30f3de0-f564-4c73-9d9f-7292ceab83b1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:37:52 user nova-compute[74131]:   <uuid>e30f3de0-f564-4c73-9d9f-7292ceab83b1</uuid>
Oct 20 16:37:52 user nova-compute[74131]:   <name>instance-0000001e</name>
Oct 20 16:37:52 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:37:52 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:37:52 user nova-compute[74131]:   <metadata>
Oct 20 16:37:52 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:37:52 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:37:52 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1949739455</nova:name>
Oct 20 16:37:52 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:37:52</nova:creationTime>
Oct 20 16:37:52 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:37:52 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:37:52 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:37:52 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:37:52 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:37:52 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:37:52 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:37:52 user nova-compute[74131]:       <nova:owner>
Oct 20 16:37:52 user nova-compute[74131]:         <nova:user uuid="501cfb16d7aa4ef78ea393a53b7aa555">tempest-AttachVolumeShelveTestJSON-189572795-project-member</nova:user>
Oct 20 16:37:52 user nova-compute[74131]:         <nova:project uuid="02e81e0cc8c84c22bcb419d79a119364">tempest-AttachVolumeShelveTestJSON-189572795</nova:project>
Oct 20 16:37:52 user nova-compute[74131]:       </nova:owner>
Oct 20 16:37:52 user nova-compute[74131]:       <nova:root type="image" uuid="015e7d74-592c-426d-91f5-3467b1b1b68d"/>
Oct 20 16:37:52 user nova-compute[74131]:       <nova:ports>
Oct 20 16:37:52 user nova-compute[74131]:         <nova:port uuid="a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee">
Oct 20 16:37:52 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 16:37:52 user nova-compute[74131]:         </nova:port>
Oct 20 16:37:52 user nova-compute[74131]:       </nova:ports>
Oct 20 16:37:52 user nova-compute[74131]:     </nova:instance>
Oct 20 16:37:52 user nova-compute[74131]:   </metadata>
Oct 20 16:37:52 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:37:52 user nova-compute[74131]:     <system>
Oct 20 16:37:52 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:37:52 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:37:52 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:37:52 user nova-compute[74131]:       <entry name="serial">e30f3de0-f564-4c73-9d9f-7292ceab83b1</entry>
Oct 20 16:37:52 user nova-compute[74131]:       <entry name="uuid">e30f3de0-f564-4c73-9d9f-7292ceab83b1</entry>
Oct 20 16:37:52 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:37:52 user nova-compute[74131]:     </system>
Oct 20 16:37:52 user nova-compute[74131]:   </sysinfo>
Oct 20 16:37:52 user nova-compute[74131]:   <os>
Oct 20 16:37:52 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:37:52 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:37:52 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:37:52 user nova-compute[74131]:   </os>
Oct 20 16:37:52 user nova-compute[74131]:   <features>
Oct 20 16:37:52 user nova-compute[74131]:     <acpi/>
Oct 20 16:37:52 user nova-compute[74131]:     <apic/>
Oct 20 16:37:52 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:37:52 user nova-compute[74131]:   </features>
Oct 20 16:37:52 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:37:52 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:37:52 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:37:52 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:37:52 user nova-compute[74131]:   </clock>
Oct 20 16:37:52 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:37:52 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:37:52 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:37:52 user nova-compute[74131]:   </cpu>
Oct 20 16:37:52 user nova-compute[74131]:   <devices>
Oct 20 16:37:52 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:37:52 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:37:52 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk"/>
Oct 20 16:37:52 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:37:52 user nova-compute[74131]:     </disk>
Oct 20 16:37:52 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:37:52 user nova-compute[74131]:       <mac address="fa:16:3e:9c:93:f1"/>
Oct 20 16:37:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:37:52 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:37:52 user nova-compute[74131]:       <target dev="tapa7757fa8-59"/>
Oct 20 16:37:52 user nova-compute[74131]:     </interface>
Oct 20 16:37:52 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:37:52 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/console.log" append="off"/>
Oct 20 16:37:52 user nova-compute[74131]:     </serial>
Oct 20 16:37:52 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:37:52 user nova-compute[74131]:     <video>
Oct 20 16:37:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:37:52 user nova-compute[74131]:     </video>
Oct 20 16:37:52 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:37:52 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:37:52 user nova-compute[74131]:     </rng>
Oct 20 16:37:52 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:37:52 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:37:52 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:37:52 user nova-compute[74131]:     </memballoon>
Oct 20 16:37:52 user nova-compute[74131]:   </devices>
Oct 20 16:37:52 user nova-compute[74131]: </domain>
Oct 20 16:37:52 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949739455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949739455',id=30,image_ref='015e7d74-592c-426d-91f5-3467b1b1b68d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2111111205',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:33:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-95zxp0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member',shelved_at='2023-10-20T16:35:55.463154',shelved_host='user',shelved_image_id='015e7d74-592c-426d-91f5-3467b1b1b68d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=e30f3de0-f564-4c73-9d9f-7292ceab83b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG os_vif [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8321c0d-67f9-5d26-8783-3ad524d36c47', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-01032aba-4d5c-45ac-a4a3-25be8f802934 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.290s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7757fa8-59, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7757fa8-59, col_values=(('qos', UUID('0d3fbf78-5014-4161-aac6-06227eccfe2c')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7757fa8-59, col_values=(('external_ids', {'iface-id': 'a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:93:f1', 'vm-uuid': 'e30f3de0-f564-4c73-9d9f-7292ceab83b1'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:52 user nova-compute[74131]: INFO os_vif [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59')
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:37:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] No VIF found with MAC fa:16:3e:9c:93:f1, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:37:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3fb2105e-151d-46df-850c-65b7e28412e9 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3fb2105e-151d-46df-850c-65b7e28412e9 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3fb2105e-151d-46df-850c-65b7e28412e9 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:37:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3fb2105e-151d-46df-850c-65b7e28412e9 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74131) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 16:37:53 user nova-compute[74131]: DEBUG nova.objects.instance [None req-3fb2105e-151d-46df-850c-65b7e28412e9 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-b51219b9-efd1-42cb-baeb-74f59f4baa78 req-91db6f06-103d-4af8-bfb8-e444873d80d1 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b51219b9-efd1-42cb-baeb-74f59f4baa78 req-91db6f06-103d-4af8-bfb8-e444873d80d1 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b51219b9-efd1-42cb-baeb-74f59f4baa78 req-91db6f06-103d-4af8-bfb8-e444873d80d1 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b51219b9-efd1-42cb-baeb-74f59f4baa78 req-91db6f06-103d-4af8-bfb8-e444873d80d1 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-b51219b9-efd1-42cb-baeb-74f59f4baa78 req-91db6f06-103d-4af8-bfb8-e444873d80d1 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:54 user nova-compute[74131]: WARNING nova.compute.manager [req-b51219b9-efd1-42cb-baeb-74f59f4baa78 req-91db6f06-103d-4af8-bfb8-e444873d80d1 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state active and task_state powering-off.
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-changed-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG nova.compute.manager [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Refreshing instance network info cache due to event network-changed-b11180ef-e4ce-449e-8b4c-4aab6be3ff20. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] Acquiring lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] Acquired lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Refreshing network info cache for port b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:37:55 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance destroyed successfully.
Oct 20 16:37:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3fb2105e-151d-46df-850c-65b7e28412e9 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:55 user nova-compute[74131]: INFO nova.compute.manager [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Terminating instance
Oct 20 16:37:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3fb2105e-151d-46df-850c-65b7e28412e9 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.458s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updated VIF entry in instance network info cache for port b11180ef-e4ce-449e-8b4c-4aab6be3ff20. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG nova.network.neutron [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updating instance_info_cache with network_info: [{"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ff7c9cc0-d176-44e2-9e8c-bf58dae8f92b req-239296cb-1c13-49e5-abd3-2b8028dee254 service nova] Releasing lock "refresh_cache-cee5222c-c297-4c9b-9eab-9f3b48d441b1" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:37:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Instance destroyed successfully.
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.objects.instance [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'resources' on Instance uuid cee5222c-c297-4c9b-9eab-9f3b48d441b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1686993738',display_name='tempest-TestStampPattern-server-1686993738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1686993738',id=32,image_ref='39a16938-10be-4fd0-9f07-39409cb2f049',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzrap9i4Orsu8IzJ1UVjCZ+WyzfeweRZL/LOfQEErLq7dnmtfZqasg1PuC2aF1xBY+d7pssB1ZDto0my2u854/qSoSCcSBXiI+sw6JGAguv5NwG+H5EAVR6yOkNKhXWPA==',key_name='tempest-TestStampPattern-1512427519',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:34:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c666b56163d8480bb7977e63b2bb534a',ramdisk_id='',reservation_id='r-9kekvbu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a16108af-bab9-4146-a928-4b2191f6f458',image_min_disk='1',image_min_ram='0',image_owner_id='c666b56163d8480bb7977e63b2bb534a',image_owner_project_name='tempest-TestStampPattern-377185534',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-377185534-project-member',image_user_id='6a4098f7e8234722be739368cd364444',owner_project_name='tempest-TestStampPattern-377185534',owner_user_name='tempest-TestStampPattern-377185534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:35:00Z,user_data=None,user_id='6a4098f7e8234722be739368cd364444',uuid=cee5222c-c297-4c9b-9eab-9f3b48d441b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converting VIF {"id": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "address": "fa:16:3e:c7:06:f1", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb11180ef-e4", "ovs_interfaceid": "b11180ef-e4ce-449e-8b4c-4aab6be3ff20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb11180ef-e4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG os_vif [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb11180ef-e4') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb11180ef-e4, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f85f642c-589d-4103-822e-1f420c51b00b) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:37:56 user nova-compute[74131]: INFO os_vif [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb11180ef-e4')
Oct 20 16:37:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Deleting instance files /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1_del
Oct 20 16:37:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Deletion of /opt/stack/data/nova/instances/cee5222c-c297-4c9b-9eab-9f3b48d441b1_del complete
Oct 20 16:37:56 user nova-compute[74131]: INFO nova.compute.manager [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:56 user nova-compute[74131]: WARNING nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state stopped and task_state None.
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:56 user nova-compute[74131]: WARNING nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received unexpected event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:56 user nova-compute[74131]: WARNING nova.compute.manager [req-75055a3c-b43d-4a1c-b7c7-99d0523e1abe req-e50fb71c-600c-459e-a6ef-a68224c6f2a8 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received unexpected event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:56 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Took 0.52 seconds to deallocate network for instance.
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-a21472d8-12a8-41fa-a9b6-9f9a1ef5e1bf req-33221421-ab0e-42f6-a200-62090f28bbb7 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-vif-deleted-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:56 user nova-compute[74131]: INFO nova.compute.manager [req-a21472d8-12a8-41fa-a9b6-9f9a1ef5e1bf req-33221421-ab0e-42f6-a200-62090f28bbb7 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Neutron deleted interface b11180ef-e4ce-449e-8b4c-4aab6be3ff20; detaching it from the instance and deleting it from the info cache
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-a21472d8-12a8-41fa-a9b6-9f9a1ef5e1bf req-33221421-ab0e-42f6-a200-62090f28bbb7 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-a21472d8-12a8-41fa-a9b6-9f9a1ef5e1bf req-33221421-ab0e-42f6-a200-62090f28bbb7 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Detach interface failed, port_id=b11180ef-e4ce-449e-8b4c-4aab6be3ff20, reason: Instance cee5222c-c297-4c9b-9eab-9f3b48d441b1 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-vif-unplugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] No waiting events found dispatching network-vif-unplugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:57 user nova-compute[74131]: WARNING nova.compute.manager [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received unexpected event network-vif-unplugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 for instance with vm_state deleted and task_state None.
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received event network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] Acquiring lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] No waiting events found dispatching network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:37:57 user nova-compute[74131]: WARNING nova.compute.manager [req-c9971a9f-693c-422f-a024-b282d380623d req-03157073-076c-4b8b-844a-3f94be5f0215 service nova] [instance: cee5222c-c297-4c9b-9eab-9f3b48d441b1] Received unexpected event network-vif-plugged-b11180ef-e4ce-449e-8b4c-4aab6be3ff20 for instance with vm_state deleted and task_state None.
Oct 20 16:37:57 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Deleted allocations for instance cee5222c-c297-4c9b-9eab-9f3b48d441b1
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:37:57 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance spawned successfully.
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-77fc8b7f-2586-43ce-b98e-0702c435b962 tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "cee5222c-c297-4c9b-9eab-9f3b48d441b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:37:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa502ca-07ee-46fc-940f-eab19508065d tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.796s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:38:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Creating image(s)
Oct 20 16:38:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Ensure instance console log exists: /opt/stack/data/nova/instances/8915ee60-7b51-465d-ba63-c933e26c8a68/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Start _get_guest_xml network_info=[{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '306122a9-8923-486e-858b-147fbf38c9bd', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8915ee60-7b51-465d-ba63-c933e26c8a68', 'attached_at': '', 'detached_at': '', 'volume_id': '40281c46-e7a9-4cf0-af38-f885962d82c2', 'serial': '40281c46-e7a9-4cf0-af38-f885962d82c2'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:38:08 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:38:08 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:38:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:38:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:38:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:38:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:38:09 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6065dd-637c-43d6-b919-6c0eea8329c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:38:09 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6b2ca-ec3f-4702-adbe-cfc7029c963c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2] added
Oct 20 16:38:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7390a4-67a0-4766-85cc-6b8262c5b2f4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6b76b-9545-4ab1-bca9-22902310789e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqColfhI {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqColfhI" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2a81eb-67df-4a4e-b592-2ba092274987]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BqColfhI'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[af58598e-c8f8-40e0-9145-f93978063f2c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ef22d7-79b2-451f-88d3-0da7aaaf36aa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:38:09 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:38:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:38:09 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:38:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c0edbc-ca1f-46c1-b6e4-5aafc8e95f7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]
Oct 20 16:38:09 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.
Oct 20 16:38:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380e28b-229e-4e06-b3e8-a273bb02904b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a19780-8c0f-421e-9d14-9fac87c49ac8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:38:09 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:38:09 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:38:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:38:09 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:38:09 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:38:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a9af0-0d7e-4b99-8ab2-886815dd4256]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:38:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23938326636376431', 'path': '/dev/sdd'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326636376431', 'path': '/dev/sdd'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-8210013',display_name='tempest-ServerActionsTestOtherA-server-8210013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-8210013',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8iuw0r7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=8915ee60-7b51-465d-ba63-c933e26c8a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'pci_devices' on Instance uuid 8915ee60-7b51-465d-ba63-c933e26c8a68 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:38:10 user nova-compute[74131]:   <uuid>8915ee60-7b51-465d-ba63-c933e26c8a68</uuid>
Oct 20 16:38:10 user nova-compute[74131]:   <name>instance-00000025</name>
Oct 20 16:38:10 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:38:10 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:38:10 user nova-compute[74131]:   <metadata>
Oct 20 16:38:10 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:38:10 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:38:10 user nova-compute[74131]:       <nova:name>tempest-ServerActionsTestOtherA-server-8210013</nova:name>
Oct 20 16:38:10 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:38:08</nova:creationTime>
Oct 20 16:38:10 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:38:10 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:38:10 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:38:10 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:38:10 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:38:10 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:38:10 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:38:10 user nova-compute[74131]:       <nova:owner>
Oct 20 16:38:10 user nova-compute[74131]:         <nova:user uuid="2f6bff83a2e24a289333823acf911ccd">tempest-ServerActionsTestOtherA-844175334-project-member</nova:user>
Oct 20 16:38:10 user nova-compute[74131]:         <nova:project uuid="69db8a4e064f445abd0a8555aaa18b88">tempest-ServerActionsTestOtherA-844175334</nova:project>
Oct 20 16:38:10 user nova-compute[74131]:       </nova:owner>
Oct 20 16:38:10 user nova-compute[74131]:       <nova:ports>
Oct 20 16:38:10 user nova-compute[74131]:         <nova:port uuid="ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce">
Oct 20 16:38:10 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 16:38:10 user nova-compute[74131]:         </nova:port>
Oct 20 16:38:10 user nova-compute[74131]:       </nova:ports>
Oct 20 16:38:10 user nova-compute[74131]:     </nova:instance>
Oct 20 16:38:10 user nova-compute[74131]:   </metadata>
Oct 20 16:38:10 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:38:10 user nova-compute[74131]:     <system>
Oct 20 16:38:10 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:38:10 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:38:10 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:38:10 user nova-compute[74131]:       <entry name="serial">8915ee60-7b51-465d-ba63-c933e26c8a68</entry>
Oct 20 16:38:10 user nova-compute[74131]:       <entry name="uuid">8915ee60-7b51-465d-ba63-c933e26c8a68</entry>
Oct 20 16:38:10 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:38:10 user nova-compute[74131]:     </system>
Oct 20 16:38:10 user nova-compute[74131]:   </sysinfo>
Oct 20 16:38:10 user nova-compute[74131]:   <os>
Oct 20 16:38:10 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:38:10 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:38:10 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:38:10 user nova-compute[74131]:   </os>
Oct 20 16:38:10 user nova-compute[74131]:   <features>
Oct 20 16:38:10 user nova-compute[74131]:     <acpi/>
Oct 20 16:38:10 user nova-compute[74131]:     <apic/>
Oct 20 16:38:10 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:38:10 user nova-compute[74131]:   </features>
Oct 20 16:38:10 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:38:10 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:38:10 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:38:10 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:38:10 user nova-compute[74131]:   </clock>
Oct 20 16:38:10 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:38:10 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:38:10 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:38:10 user nova-compute[74131]:   </cpu>
Oct 20 16:38:10 user nova-compute[74131]:   <devices>
Oct 20 16:38:10 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:38:10 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:38:10 user nova-compute[74131]:       <source dev="/dev/sdd"/>
Oct 20 16:38:10 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:38:10 user nova-compute[74131]:       <serial>40281c46-e7a9-4cf0-af38-f885962d82c2</serial>
Oct 20 16:38:10 user nova-compute[74131]:     </disk>
Oct 20 16:38:10 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:38:10 user nova-compute[74131]:       <mac address="fa:16:3e:31:21:e2"/>
Oct 20 16:38:10 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:38:10 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:38:10 user nova-compute[74131]:       <target dev="tapef823c6f-ea"/>
Oct 20 16:38:10 user nova-compute[74131]:     </interface>
Oct 20 16:38:10 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:38:10 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/8915ee60-7b51-465d-ba63-c933e26c8a68/console.log" append="off"/>
Oct 20 16:38:10 user nova-compute[74131]:     </serial>
Oct 20 16:38:10 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:38:10 user nova-compute[74131]:     <video>
Oct 20 16:38:10 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:38:10 user nova-compute[74131]:     </video>
Oct 20 16:38:10 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:38:10 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:38:10 user nova-compute[74131]:     </rng>
Oct 20 16:38:10 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:38:10 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:38:10 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:38:10 user nova-compute[74131]:     </memballoon>
Oct 20 16:38:10 user nova-compute[74131]:   </devices>
Oct 20 16:38:10 user nova-compute[74131]: </domain>
Oct 20 16:38:10 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-8210013',display_name='tempest-ServerActionsTestOtherA-server-8210013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-8210013',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8iuw0r7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=8915ee60-7b51-465d-ba63-c933e26c8a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG os_vif [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4f31e8e-33cd-599e-a19b-fe93e127001d', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef823c6f-ea, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef823c6f-ea, col_values=(('qos', UUID('3ae9e390-5cae-4b82-b1ac-263c13a9d462')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef823c6f-ea, col_values=(('external_ids', {'iface-id': 'ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:21:e2', 'vm-uuid': '8915ee60-7b51-465d-ba63-c933e26c8a68'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:10 user nova-compute[74131]: INFO os_vif [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea')
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:38:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No VIF found with MAC fa:16:3e:31:21:e2, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:38:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-1ad35c0c-d1f0-4335-98ea-81b78a043443 req-d55b4b1b-79c2-479b-966c-75658a7f2956 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:38:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1ad35c0c-d1f0-4335-98ea-81b78a043443 req-d55b4b1b-79c2-479b-966c-75658a7f2956 service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1ad35c0c-d1f0-4335-98ea-81b78a043443 req-d55b4b1b-79c2-479b-966c-75658a7f2956 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1ad35c0c-d1f0-4335-98ea-81b78a043443 req-d55b4b1b-79c2-479b-966c-75658a7f2956 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-1ad35c0c-d1f0-4335-98ea-81b78a043443 req-d55b4b1b-79c2-479b-966c-75658a7f2956 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:38:12 user nova-compute[74131]: WARNING nova.compute.manager [req-1ad35c0c-d1f0-4335-98ea-81b78a043443 req-d55b4b1b-79c2-479b-966c-75658a7f2956 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received unexpected event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with vm_state building and task_state spawning.
Oct 20 16:38:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:38:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance spawned successfully.
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-8064a9b4-17a3-4b7c-b643-67982b1a9b51 req-f32b4889-0b1c-4baf-8521-a848dfe7b1d1 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8064a9b4-17a3-4b7c-b643-67982b1a9b51 req-f32b4889-0b1c-4baf-8521-a848dfe7b1d1 service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8064a9b4-17a3-4b7c-b643-67982b1a9b51 req-f32b4889-0b1c-4baf-8521-a848dfe7b1d1 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8064a9b4-17a3-4b7c-b643-67982b1a9b51 req-f32b4889-0b1c-4baf-8521-a848dfe7b1d1 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-8064a9b4-17a3-4b7c-b643-67982b1a9b51 req-f32b4889-0b1c-4baf-8521-a848dfe7b1d1 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:38:14 user nova-compute[74131]: WARNING nova.compute.manager [req-8064a9b4-17a3-4b7c-b643-67982b1a9b51 req-f32b4889-0b1c-4baf-8521-a848dfe7b1d1 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received unexpected event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with vm_state building and task_state spawning.
Oct 20 16:38:14 user nova-compute[74131]: INFO nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 20 16:38:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:38:14 user nova-compute[74131]: INFO nova.compute.manager [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Took 30.93 seconds to build instance.
Oct 20 16:38:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b5c9689c-5b0c-44fa-9909-64602cc400a0 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.025s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:38:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:38:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:38:25 user nova-compute[74131]: INFO nova.compute.claims [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Claim successful on node user
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:38:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:26 user nova-compute[74131]: INFO nova.virt.block_device [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Booting with volume-backed-image 5632de9b-7b89-4624-9137-cb6ef38be112 at /dev/vda
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.policy [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82534b86e314f00896042e2e684a623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097a2eccca244cbfa897e6a573a3113d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Successfully created port: 16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:38:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Successfully updated port: 16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:38:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:38:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:38:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-changed-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Refreshing instance network info cache due to event network-changed-16d519d4-421e-4301-8d21-6b7a16eafa47. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] Acquiring lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Updating instance_info_cache with network_info: [{"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance network_info: |[{"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] Acquired lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Refreshing network info cache for port 16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Updated VIF entry in instance network info cache for port 16d519d4-421e-4301-8d21-6b7a16eafa47. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Updating instance_info_cache with network_info: [{"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:38:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-866157a3-1334-4b2d-9c93-55cbea1ebb33 req-5b45419e-65a6-4d33-b82e-17125b4c6d18 service nova] Releasing lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:38:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:38:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:38:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:35 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:38:35 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7801MB free_disk=24.8641357421875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a16108af-bab9-4146-a928-4b2191f6f458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 8915ee60-7b51-465d-ba63-c933e26c8a68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e30f3de0-f564-4c73-9d9f-7292ceab83b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e20dc23f-56e8-4800-89a0-b93db4520e1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:38:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:38:36 user nova-compute[74131]: INFO nova.compute.claims [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Claim successful on node user
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:38:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:38:36 user nova-compute[74131]: DEBUG nova.policy [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '920bc059cf2644199effa540a62c07ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ae0ab6863f4f07a65fbe7bc98e1e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:38:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Creating image(s)
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "/opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "/opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk 1073741824" returned: 0 in 0.056s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.213s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Successfully created port: 26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Cannot resize image /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Ensure instance console log exists: /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Successfully updated port: 26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "refresh_cache-d2d6ed79-93cb-4689-8ea2-46daf90a65c0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquired lock "refresh_cache-d2d6ed79-93cb-4689-8ea2-46daf90a65c0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received event network-changed-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Refreshing instance network info cache due to event network-changed-26dfd7d0-991d-4b43-9162-60ca4f326488. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] Acquiring lock "refresh_cache-d2d6ed79-93cb-4689-8ea2-46daf90a65c0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Updating instance_info_cache with network_info: [{"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Releasing lock "refresh_cache-d2d6ed79-93cb-4689-8ea2-46daf90a65c0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Instance network_info: |[{"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] Acquired lock "refresh_cache-d2d6ed79-93cb-4689-8ea2-46daf90a65c0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.network.neutron [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Refreshing network info cache for port 26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Start _get_guest_xml network_info=[{"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:38:38 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:38:38 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-530622663',display_name='tempest-VolumesActionsTest-instance-530622663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-530622663',id=39,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ae0ab6863f4f07a65fbe7bc98e1e24',ramdisk_id='',reservation_id='r-30ah2ua6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1417678142',owner_user_name='tempest-VolumesActionsTest-1417678142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:38:37Z,user_data=None,user_id='920bc059cf2644199effa540a62c07ea',uuid=d2d6ed79-93cb-4689-8ea2-46daf90a65c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converting VIF {"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=26dfd7d0-991d-4b43-9162-60ca4f326488,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfd7d0-99') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:38:38 user nova-compute[74131]: DEBUG nova.objects.instance [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lazy-loading 'pci_devices' on Instance uuid d2d6ed79-93cb-4689-8ea2-46daf90a65c0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:38:39 user nova-compute[74131]:   <uuid>d2d6ed79-93cb-4689-8ea2-46daf90a65c0</uuid>
Oct 20 16:38:39 user nova-compute[74131]:   <name>instance-00000027</name>
Oct 20 16:38:39 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:38:39 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:38:39 user nova-compute[74131]:   <metadata>
Oct 20 16:38:39 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:38:39 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:38:39 user nova-compute[74131]:       <nova:name>tempest-VolumesActionsTest-instance-530622663</nova:name>
Oct 20 16:38:39 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:38:38</nova:creationTime>
Oct 20 16:38:39 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:38:39 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:38:39 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:38:39 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:38:39 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:38:39 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:38:39 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:38:39 user nova-compute[74131]:       <nova:owner>
Oct 20 16:38:39 user nova-compute[74131]:         <nova:user uuid="920bc059cf2644199effa540a62c07ea">tempest-VolumesActionsTest-1417678142-project-member</nova:user>
Oct 20 16:38:39 user nova-compute[74131]:         <nova:project uuid="22ae0ab6863f4f07a65fbe7bc98e1e24">tempest-VolumesActionsTest-1417678142</nova:project>
Oct 20 16:38:39 user nova-compute[74131]:       </nova:owner>
Oct 20 16:38:39 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:38:39 user nova-compute[74131]:       <nova:ports>
Oct 20 16:38:39 user nova-compute[74131]:         <nova:port uuid="26dfd7d0-991d-4b43-9162-60ca4f326488">
Oct 20 16:38:39 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 16:38:39 user nova-compute[74131]:         </nova:port>
Oct 20 16:38:39 user nova-compute[74131]:       </nova:ports>
Oct 20 16:38:39 user nova-compute[74131]:     </nova:instance>
Oct 20 16:38:39 user nova-compute[74131]:   </metadata>
Oct 20 16:38:39 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:38:39 user nova-compute[74131]:     <system>
Oct 20 16:38:39 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:38:39 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:38:39 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:38:39 user nova-compute[74131]:       <entry name="serial">d2d6ed79-93cb-4689-8ea2-46daf90a65c0</entry>
Oct 20 16:38:39 user nova-compute[74131]:       <entry name="uuid">d2d6ed79-93cb-4689-8ea2-46daf90a65c0</entry>
Oct 20 16:38:39 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:38:39 user nova-compute[74131]:     </system>
Oct 20 16:38:39 user nova-compute[74131]:   </sysinfo>
Oct 20 16:38:39 user nova-compute[74131]:   <os>
Oct 20 16:38:39 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:38:39 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:38:39 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:38:39 user nova-compute[74131]:   </os>
Oct 20 16:38:39 user nova-compute[74131]:   <features>
Oct 20 16:38:39 user nova-compute[74131]:     <acpi/>
Oct 20 16:38:39 user nova-compute[74131]:     <apic/>
Oct 20 16:38:39 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:38:39 user nova-compute[74131]:   </features>
Oct 20 16:38:39 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:38:39 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:38:39 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:38:39 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:38:39 user nova-compute[74131]:   </clock>
Oct 20 16:38:39 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:38:39 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:38:39 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:38:39 user nova-compute[74131]:   </cpu>
Oct 20 16:38:39 user nova-compute[74131]:   <devices>
Oct 20 16:38:39 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:38:39 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:38:39 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk"/>
Oct 20 16:38:39 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:38:39 user nova-compute[74131]:     </disk>
Oct 20 16:38:39 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:38:39 user nova-compute[74131]:       <mac address="fa:16:3e:5a:2f:74"/>
Oct 20 16:38:39 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:38:39 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:38:39 user nova-compute[74131]:       <target dev="tap26dfd7d0-99"/>
Oct 20 16:38:39 user nova-compute[74131]:     </interface>
Oct 20 16:38:39 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:38:39 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/console.log" append="off"/>
Oct 20 16:38:39 user nova-compute[74131]:     </serial>
Oct 20 16:38:39 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:38:39 user nova-compute[74131]:     <video>
Oct 20 16:38:39 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:38:39 user nova-compute[74131]:     </video>
Oct 20 16:38:39 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:38:39 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:38:39 user nova-compute[74131]:     </rng>
Oct 20 16:38:39 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:38:39 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:38:39 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:38:39 user nova-compute[74131]:     </memballoon>
Oct 20 16:38:39 user nova-compute[74131]:   </devices>
Oct 20 16:38:39 user nova-compute[74131]: </domain>
Oct 20 16:38:39 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-530622663',display_name='tempest-VolumesActionsTest-instance-530622663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-530622663',id=39,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ae0ab6863f4f07a65fbe7bc98e1e24',ramdisk_id='',reservation_id='r-30ah2ua6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1417678142',owner_user_name='tempest-VolumesActionsTest-1417678142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:38:37Z,user_data=None,user_id='920bc059cf2644199effa540a62c07ea',uuid=d2d6ed79-93cb-4689-8ea2-46daf90a65c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converting VIF {"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=26dfd7d0-991d-4b43-9162-60ca4f326488,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfd7d0-99') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG os_vif [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=26dfd7d0-991d-4b43-9162-60ca4f326488,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfd7d0-99') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '511fe492-66c2-58f0-b6ee-68323ce77cca', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dfd7d0-99, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26dfd7d0-99, col_values=(('qos', UUID('b6c9cb74-1ba7-443c-a3cb-8b6ec8253915')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26dfd7d0-99, col_values=(('external_ids', {'iface-id': '26dfd7d0-991d-4b43-9162-60ca4f326488', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:2f:74', 'vm-uuid': 'd2d6ed79-93cb-4689-8ea2-46daf90a65c0'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:39 user nova-compute[74131]: INFO os_vif [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=26dfd7d0-991d-4b43-9162-60ca4f326488,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfd7d0-99')
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] No VIF found with MAC fa:16:3e:5a:2f:74, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Updated VIF entry in instance network info cache for port 26dfd7d0-991d-4b43-9162-60ca4f326488. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Updating instance_info_cache with network_info: [{"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:38:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9a9958c-ecfa-4d22-834b-6d494529e268 req-1c3eb656-7566-430a-8ea2-7ee2b05f940f service nova] Releasing lock "refresh_cache-d2d6ed79-93cb-4689-8ea2-46daf90a65c0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7ac2716-07c5-4257-afbf-916ba7e2a48f req-07d25a66-77e8-4241-a2cc-316977a975e1 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received event network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7ac2716-07c5-4257-afbf-916ba7e2a48f req-07d25a66-77e8-4241-a2cc-316977a975e1 service nova] Acquiring lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7ac2716-07c5-4257-afbf-916ba7e2a48f req-07d25a66-77e8-4241-a2cc-316977a975e1 service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a7ac2716-07c5-4257-afbf-916ba7e2a48f req-07d25a66-77e8-4241-a2cc-316977a975e1 service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-a7ac2716-07c5-4257-afbf-916ba7e2a48f req-07d25a66-77e8-4241-a2cc-316977a975e1 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] No waiting events found dispatching network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:38:40 user nova-compute[74131]: WARNING nova.compute.manager [req-a7ac2716-07c5-4257-afbf-916ba7e2a48f req-07d25a66-77e8-4241-a2cc-316977a975e1 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received unexpected event network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 for instance with vm_state building and task_state spawning.
Oct 20 16:38:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG os_brick.utils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2ab5c-d982-4c1c-9c00-0bda713427b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b865fc1-0724-43dc-bd3f-4b6a6c1f56fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a302fe-c1ed-466f-92aa-b98aa7aa23f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf955976-48a4-40bb-b9ff-cf0707605935]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:38:42 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921ef4f-bcb4-468f-a642-cd6384352068]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG os_brick.utils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Updating existing volume attachment record: 3e7c4a33-8b43-44b9-b2b7-e49309b3675d {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:38:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Instance spawned successfully.
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:38:42 user nova-compute[74131]: INFO nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-c0baf7c9-3083-4106-9986-0a9b0160d68c req-ba2c69e1-31b0-4993-b0ce-c6722f2079f8 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received event network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c0baf7c9-3083-4106-9986-0a9b0160d68c req-ba2c69e1-31b0-4993-b0ce-c6722f2079f8 service nova] Acquiring lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c0baf7c9-3083-4106-9986-0a9b0160d68c req-ba2c69e1-31b0-4993-b0ce-c6722f2079f8 service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c0baf7c9-3083-4106-9986-0a9b0160d68c req-ba2c69e1-31b0-4993-b0ce-c6722f2079f8 service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-c0baf7c9-3083-4106-9986-0a9b0160d68c req-ba2c69e1-31b0-4993-b0ce-c6722f2079f8 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] No waiting events found dispatching network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:38:42 user nova-compute[74131]: WARNING nova.compute.manager [req-c0baf7c9-3083-4106-9986-0a9b0160d68c req-ba2c69e1-31b0-4993-b0ce-c6722f2079f8 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received unexpected event network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 for instance with vm_state building and task_state spawning.
Oct 20 16:38:42 user nova-compute[74131]: INFO nova.compute.manager [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Took 6.65 seconds to build instance.
Oct 20 16:38:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-d65af221-3a67-44e8-8b77-d166f7a6c6b8 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.769s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:38:50 user nova-compute[74131]: INFO nova.compute.claims [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Claim successful on node user
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:38:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:38:50 user nova-compute[74131]: DEBUG nova.policy [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c0f3a5e9862491897ec87644c577ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08267e8d79941d3a555dc3a51c58985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:38:50 user nova-compute[74131]: INFO nova.virt.block_device [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Booting with volume fd468416-0b4e-4d5f-97a7-71806199ac31 at /dev/vda
Oct 20 16:38:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d039e1-2be8-49aa-87aa-023d7b69b268]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a23890-4815-4cdd-a871-68a7c71931c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfba17f-d0ea-4600-9ae9-56ba239e3b59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fb82a5-cea8-4b00-86b7-10e822f3b948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:38:51 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:38:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd110a-cfad-4d9e-b66a-a1b4c90126fa]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG os_brick.utils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Updating existing volume attachment record: e9d7f07f-4fe7-4cc9-ac73-07f51835913e {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:38:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Successfully created port: d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Successfully updated port: d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-changed-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.compute.manager [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Refreshing instance network info cache due to event network-changed-d5d6f4b5-333b-4241-a097-232e842afb20. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] Acquiring lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] Acquired lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Refreshing network info cache for port d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.network.neutron [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f31a973a-6345-490c-827a-35a2d41b6676 req-5ab62264-82f4-42d2-82f3-e40d2bcb9238 service nova] Releasing lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquired lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:38:52 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:38:53 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Updating instance_info_cache with network_info: [{"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:38:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Releasing lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:38:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Instance network_info: |[{"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:38:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:38:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:38:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:38:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:38:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:38:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:39:01 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Creating image(s)
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Ensure instance console log exists: /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Start _get_guest_xml network_info=[{"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3e7c4a33-8b43-44b9-b2b7-e49309b3675d', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfcMoVWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e20dc23f-56e8-4800-89a0-b93db4520e1d', 'attached_at': '', 'detached_at': '', 'volume_id': '5d619add-e12e-42ae-af37-13bc337e37f4', 'serial': '5d619add-e12e-42ae-af37-13bc337e37f4'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:39:01 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:01 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfcMoVWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:01 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:01 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:01 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:39:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c49948-0fcf-474d-8c6f-3137b8e0a72e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:39:02 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b42232-9290-4337-bd7b-7b6f4df0af20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4] added
Oct 20 16:39:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48def72-4b86-4f64-b2a6-8dc04d220334]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d4084-fd4f-4d34-833f-eff8b6f968d3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfcMoVWK {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfcMoVWK" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[36485f36-4d6e-4b00-aeb2-f1f700496398]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfcMoVWK'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0287dc77-87bb-41ba-93a3-b7a3f651fd79]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4daf99-7373-425c-91f2-b59dd4ef11a2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51cfef-c00a-4a7e-91df-20ecc2cf415a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260]
Oct 20 16:39:02 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ed3be-5a37-4295-a2e6-9e08644ef0fe]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aea27ff-476d-4ad3-bccd-a51340361ba7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:02 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:02 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1eaa3-c6f2-481a-8286-4e76fa205851]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfcMoVWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lazy-loading 'flavor' on Instance uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:02 user nova-compute[74131]: INFO nova.compute.manager [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Attaching volume 5da99352-e9ec-4fc3-996f-e3e5c300bf28 to /dev/vdb
Oct 20 16:39:02 user nova-compute[74131]: DEBUG os_brick.utils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e92dc5-eeb2-494b-902e-5f6400bfc617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4ebfde-e898-4ddc-a29e-a40aa0729b16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc63f90d-f33b-4d0b-82f0-1902549b5bab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49af780-1882-4f68-9245-d94ba17145af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:39:03 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:39:03 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f244fd5-72c8-4b66-9aa8-b2f3025e6820]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_brick.utils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating existing volume attachment record: 3fbd1548-fb73-4065-822d-96385ec6dcc1 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26239636262386363', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239636262386363', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1418458451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1418458451',id=38,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-9kmg8d6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:38:26Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=e20dc23f-56e8-4800-89a0-b93db4520e1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.objects.instance [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'pci_devices' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:39:03 user nova-compute[74131]:   <uuid>e20dc23f-56e8-4800-89a0-b93db4520e1d</uuid>
Oct 20 16:39:03 user nova-compute[74131]:   <name>instance-00000026</name>
Oct 20 16:39:03 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:39:03 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:39:03 user nova-compute[74131]:   <metadata>
Oct 20 16:39:03 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:39:03 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:39:03 user nova-compute[74131]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1418458451</nova:name>
Oct 20 16:39:03 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:39:01</nova:creationTime>
Oct 20 16:39:03 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:39:03 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:39:03 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:39:03 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:39:03 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:39:03 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:39:03 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:39:03 user nova-compute[74131]:       <nova:owner>
Oct 20 16:39:03 user nova-compute[74131]:         <nova:user uuid="a82534b86e314f00896042e2e684a623">tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member</nova:user>
Oct 20 16:39:03 user nova-compute[74131]:         <nova:project uuid="097a2eccca244cbfa897e6a573a3113d">tempest-ServerBootFromVolumeStableRescueTest-131352591</nova:project>
Oct 20 16:39:03 user nova-compute[74131]:       </nova:owner>
Oct 20 16:39:03 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:39:03 user nova-compute[74131]:       <nova:ports>
Oct 20 16:39:03 user nova-compute[74131]:         <nova:port uuid="16d519d4-421e-4301-8d21-6b7a16eafa47">
Oct 20 16:39:03 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 16:39:03 user nova-compute[74131]:         </nova:port>
Oct 20 16:39:03 user nova-compute[74131]:       </nova:ports>
Oct 20 16:39:03 user nova-compute[74131]:     </nova:instance>
Oct 20 16:39:03 user nova-compute[74131]:   </metadata>
Oct 20 16:39:03 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:39:03 user nova-compute[74131]:     <system>
Oct 20 16:39:03 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:39:03 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:39:03 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:39:03 user nova-compute[74131]:       <entry name="serial">e20dc23f-56e8-4800-89a0-b93db4520e1d</entry>
Oct 20 16:39:03 user nova-compute[74131]:       <entry name="uuid">e20dc23f-56e8-4800-89a0-b93db4520e1d</entry>
Oct 20 16:39:03 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:39:03 user nova-compute[74131]:     </system>
Oct 20 16:39:03 user nova-compute[74131]:   </sysinfo>
Oct 20 16:39:03 user nova-compute[74131]:   <os>
Oct 20 16:39:03 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:39:03 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:39:03 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:39:03 user nova-compute[74131]:   </os>
Oct 20 16:39:03 user nova-compute[74131]:   <features>
Oct 20 16:39:03 user nova-compute[74131]:     <acpi/>
Oct 20 16:39:03 user nova-compute[74131]:     <apic/>
Oct 20 16:39:03 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:39:03 user nova-compute[74131]:   </features>
Oct 20 16:39:03 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:39:03 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:39:03 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:39:03 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:39:03 user nova-compute[74131]:   </clock>
Oct 20 16:39:03 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:39:03 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:39:03 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:39:03 user nova-compute[74131]:   </cpu>
Oct 20 16:39:03 user nova-compute[74131]:   <devices>
Oct 20 16:39:03 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:39:03 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:39:03 user nova-compute[74131]:       <source dev="/dev/sde"/>
Oct 20 16:39:03 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:39:03 user nova-compute[74131]:       <serial>5d619add-e12e-42ae-af37-13bc337e37f4</serial>
Oct 20 16:39:03 user nova-compute[74131]:     </disk>
Oct 20 16:39:03 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:39:03 user nova-compute[74131]:       <mac address="fa:16:3e:f8:3a:66"/>
Oct 20 16:39:03 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:03 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:39:03 user nova-compute[74131]:       <target dev="tap16d519d4-42"/>
Oct 20 16:39:03 user nova-compute[74131]:     </interface>
Oct 20 16:39:03 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:39:03 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/console.log" append="off"/>
Oct 20 16:39:03 user nova-compute[74131]:     </serial>
Oct 20 16:39:03 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:39:03 user nova-compute[74131]:     <video>
Oct 20 16:39:03 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:03 user nova-compute[74131]:     </video>
Oct 20 16:39:03 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:39:03 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:39:03 user nova-compute[74131]:     </rng>
Oct 20 16:39:03 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:39:03 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:39:03 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:39:03 user nova-compute[74131]:     </memballoon>
Oct 20 16:39:03 user nova-compute[74131]:   </devices>
Oct 20 16:39:03 user nova-compute[74131]: </domain>
Oct 20 16:39:03 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1418458451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1418458451',id=38,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-9kmg8d6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:38:26Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=e20dc23f-56e8-4800-89a0-b93db4520e1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG os_vif [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80b062d3-e151-5ea5-9220-4c4f07f37587', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16d519d4-42, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16d519d4-42, col_values=(('qos', UUID('38c15091-aa9b-4439-b323-5c8206e77a54')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16d519d4-42, col_values=(('external_ids', {'iface-id': '16d519d4-421e-4301-8d21-6b7a16eafa47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:3a:66', 'vm-uuid': 'e20dc23f-56e8-4800-89a0-b93db4520e1d'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:03 user nova-compute[74131]: INFO os_vif [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42')
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:39:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No VIF found with MAC fa:16:3e:f8:3a:66, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:39:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-28a38878-5247-47f9-8402-8ae79f89cc67 req-7a174d63-ac5c-49d4-b50f-5fe89f2f5b80 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-28a38878-5247-47f9-8402-8ae79f89cc67 req-7a174d63-ac5c-49d4-b50f-5fe89f2f5b80 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-28a38878-5247-47f9-8402-8ae79f89cc67 req-7a174d63-ac5c-49d4-b50f-5fe89f2f5b80 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-28a38878-5247-47f9-8402-8ae79f89cc67 req-7a174d63-ac5c-49d4-b50f-5fe89f2f5b80 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-28a38878-5247-47f9-8402-8ae79f89cc67 req-7a174d63-ac5c-49d4-b50f-5fe89f2f5b80 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:05 user nova-compute[74131]: WARNING nova.compute.manager [req-28a38878-5247-47f9-8402-8ae79f89cc67 req-7a174d63-ac5c-49d4-b50f-5fe89f2f5b80 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state building and task_state spawning.
Oct 20 16:39:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-5b311ab9-3122-4fb5-9574-e31fd536a547 req-dda867ac-1a91-4e9d-87af-8dd171251381 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5b311ab9-3122-4fb5-9574-e31fd536a547 req-dda867ac-1a91-4e9d-87af-8dd171251381 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5b311ab9-3122-4fb5-9574-e31fd536a547 req-dda867ac-1a91-4e9d-87af-8dd171251381 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5b311ab9-3122-4fb5-9574-e31fd536a547 req-dda867ac-1a91-4e9d-87af-8dd171251381 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-5b311ab9-3122-4fb5-9574-e31fd536a547 req-dda867ac-1a91-4e9d-87af-8dd171251381 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:07 user nova-compute[74131]: WARNING nova.compute.manager [req-5b311ab9-3122-4fb5-9574-e31fd536a547 req-dda867ac-1a91-4e9d-87af-8dd171251381 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state building and task_state spawning.
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:39:07 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance spawned successfully.
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:07 user nova-compute[74131]: INFO nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 20 16:39:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:39:07 user nova-compute[74131]: INFO nova.compute.manager [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Took 42.09 seconds to build instance.
Oct 20 16:39:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2d383387-532c-436c-b616-b58a4383bda0 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.215s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:39:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Creating image(s)
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Ensure instance console log exists: /opt/stack/data/nova/instances/4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Start _get_guest_xml network_info=[{"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e9d7f07f-4fe7-4cc9-ac73-07f51835913e', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd468416-0b4e-4d5f-97a7-71806199ac31', 'serial': 'fd468416-0b4e-4d5f-97a7-71806199ac31'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:39:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:10 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a5efa6-ba2d-404f-beb2-1e22f590e16b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:39:10 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[61685eb5-c5ae-4477-9963-fdfa4c033ae1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31] added
Oct 20 16:39:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3636741-83ab-4448-9029-d5be299b1219]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f00d1b-33b0-434e-81a3-93f96e13f353]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZrqEhAp {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZrqEhAp" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4188000e-1ee9-4358-88c2-04bd8daeb75c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DZrqEhAp'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd135cd7-cddb-4f92-995c-db2b47368027]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd916262-9e0d-4b51-b256-30631c44acce]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:10 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:10 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:10 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:10 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:10 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:10 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5ee029-524c-4657-8cfc-295d8c69baee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]
Oct 20 16:39:11 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:11 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2da881-84fd-49a8-b503-c056ba8300ff]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45f2fcc-751e-44e4-ab37-d9bde06b0017]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:11 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:11 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:11 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[49354ac6-1c34-4e53-99f4-9bf22ddf8ed4]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-changed-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Refreshing instance network info cache due to event network-changed-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] Acquiring lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] Acquired lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.network.neutron [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Refreshing network info cache for port 8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:11 user nova-compute[74131]: INFO nova.compute.manager [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Terminating instance
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.network.neutron [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updated VIF entry in instance network info cache for port 8f7d9300-b2cb-4eed-a1d4-48f9ecfce446. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.network.neutron [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updating instance_info_cache with network_info: [{"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-76cd68fb-cd97-4de0-a224-a2a3a5a0a8b1 req-b88ec571-68c7-4d90-8012-78895b2d5d33 service nova] Releasing lock "refresh_cache-a16108af-bab9-4146-a928-4b2191f6f458" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-d2b87d99-5155-4c26-9595-9d82b4df7790 req-391c7210-af36-4b78-bc80-1bdc69abef2b service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-vif-unplugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d2b87d99-5155-4c26-9595-9d82b4df7790 req-391c7210-af36-4b78-bc80-1bdc69abef2b service nova] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d2b87d99-5155-4c26-9595-9d82b4df7790 req-391c7210-af36-4b78-bc80-1bdc69abef2b service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d2b87d99-5155-4c26-9595-9d82b4df7790 req-391c7210-af36-4b78-bc80-1bdc69abef2b service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-d2b87d99-5155-4c26-9595-9d82b4df7790 req-391c7210-af36-4b78-bc80-1bdc69abef2b service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] No waiting events found dispatching network-vif-unplugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-d2b87d99-5155-4c26-9595-9d82b4df7790 req-391c7210-af36-4b78-bc80-1bdc69abef2b service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-vif-unplugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23030333666663134', 'path': '/dev/sdf'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333666663134', 'path': '/dev/sdf'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-577548710',display_name='tempest-TestVolumeBootPattern-server-577548710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-577548710',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-zfhz5n8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:38:51Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2b:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5d6f4b5-333b-4241-a097-232e842afb20,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d6f4b5-33') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'pci_devices' on Instance uuid 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:39:12 user nova-compute[74131]:   <uuid>4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6</uuid>
Oct 20 16:39:12 user nova-compute[74131]:   <name>instance-00000028</name>
Oct 20 16:39:12 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:39:12 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:39:12 user nova-compute[74131]:   <metadata>
Oct 20 16:39:12 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:39:12 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:39:12 user nova-compute[74131]:       <nova:name>tempest-TestVolumeBootPattern-server-577548710</nova:name>
Oct 20 16:39:12 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:39:10</nova:creationTime>
Oct 20 16:39:12 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:39:12 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:39:12 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:39:12 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:39:12 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:39:12 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:39:12 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:39:12 user nova-compute[74131]:       <nova:owner>
Oct 20 16:39:12 user nova-compute[74131]:         <nova:user uuid="6c0f3a5e9862491897ec87644c577ebf">tempest-TestVolumeBootPattern-978997028-project-member</nova:user>
Oct 20 16:39:12 user nova-compute[74131]:         <nova:project uuid="a08267e8d79941d3a555dc3a51c58985">tempest-TestVolumeBootPattern-978997028</nova:project>
Oct 20 16:39:12 user nova-compute[74131]:       </nova:owner>
Oct 20 16:39:12 user nova-compute[74131]:       <nova:ports>
Oct 20 16:39:12 user nova-compute[74131]:         <nova:port uuid="d5d6f4b5-333b-4241-a097-232e842afb20">
Oct 20 16:39:12 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 16:39:12 user nova-compute[74131]:         </nova:port>
Oct 20 16:39:12 user nova-compute[74131]:       </nova:ports>
Oct 20 16:39:12 user nova-compute[74131]:     </nova:instance>
Oct 20 16:39:12 user nova-compute[74131]:   </metadata>
Oct 20 16:39:12 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:39:12 user nova-compute[74131]:     <system>
Oct 20 16:39:12 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:39:12 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:39:12 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:39:12 user nova-compute[74131]:       <entry name="serial">4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6</entry>
Oct 20 16:39:12 user nova-compute[74131]:       <entry name="uuid">4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6</entry>
Oct 20 16:39:12 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:39:12 user nova-compute[74131]:     </system>
Oct 20 16:39:12 user nova-compute[74131]:   </sysinfo>
Oct 20 16:39:12 user nova-compute[74131]:   <os>
Oct 20 16:39:12 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:39:12 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:39:12 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:39:12 user nova-compute[74131]:   </os>
Oct 20 16:39:12 user nova-compute[74131]:   <features>
Oct 20 16:39:12 user nova-compute[74131]:     <acpi/>
Oct 20 16:39:12 user nova-compute[74131]:     <apic/>
Oct 20 16:39:12 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:39:12 user nova-compute[74131]:   </features>
Oct 20 16:39:12 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:39:12 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:39:12 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:39:12 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:39:12 user nova-compute[74131]:   </clock>
Oct 20 16:39:12 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:39:12 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:39:12 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:39:12 user nova-compute[74131]:   </cpu>
Oct 20 16:39:12 user nova-compute[74131]:   <devices>
Oct 20 16:39:12 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:39:12 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:39:12 user nova-compute[74131]:       <source dev="/dev/sdf"/>
Oct 20 16:39:12 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:39:12 user nova-compute[74131]:       <serial>fd468416-0b4e-4d5f-97a7-71806199ac31</serial>
Oct 20 16:39:12 user nova-compute[74131]:     </disk>
Oct 20 16:39:12 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:39:12 user nova-compute[74131]:       <mac address="fa:16:3e:1b:2b:b8"/>
Oct 20 16:39:12 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:12 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:39:12 user nova-compute[74131]:       <target dev="tapd5d6f4b5-33"/>
Oct 20 16:39:12 user nova-compute[74131]:     </interface>
Oct 20 16:39:12 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:39:12 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6/console.log" append="off"/>
Oct 20 16:39:12 user nova-compute[74131]:     </serial>
Oct 20 16:39:12 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:39:12 user nova-compute[74131]:     <video>
Oct 20 16:39:12 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:12 user nova-compute[74131]:     </video>
Oct 20 16:39:12 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:39:12 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:39:12 user nova-compute[74131]:     </rng>
Oct 20 16:39:12 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:39:12 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:39:12 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:39:12 user nova-compute[74131]:     </memballoon>
Oct 20 16:39:12 user nova-compute[74131]:   </devices>
Oct 20 16:39:12 user nova-compute[74131]: </domain>
Oct 20 16:39:12 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-577548710',display_name='tempest-TestVolumeBootPattern-server-577548710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-577548710',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-zfhz5n8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:38:51Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2b:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5d6f4b5-333b-4241-a097-232e842afb20,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d6f4b5-33') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG os_vif [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2b:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5d6f4b5-333b-4241-a097-232e842afb20,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d6f4b5-33') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82fdaf58-2ae6-55f0-bf76-d8c56040469d', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5d6f4b5-33, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5d6f4b5-33, col_values=(('qos', UUID('f922b076-045b-4d6a-ae7b-d7a04ceab5fd')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5d6f4b5-33, col_values=(('external_ids', {'iface-id': 'd5d6f4b5-333b-4241-a097-232e842afb20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:2b:b8', 'vm-uuid': '4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: INFO os_vif [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2b:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5d6f4b5-333b-4241-a097-232e842afb20,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d6f4b5-33')
Oct 20 16:39:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Instance destroyed successfully.
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.objects.instance [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lazy-loading 'resources' on Instance uuid a16108af-bab9-4146-a928-4b2191f6f458 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-203074645',display_name='tempest-TestStampPattern-server-203074645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-203074645',id=27,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzrap9i4Orsu8IzJ1UVjCZ+WyzfeweRZL/LOfQEErLq7dnmtfZqasg1PuC2aF1xBY+d7pssB1ZDto0my2u854/qSoSCcSBXiI+sw6JGAguv5NwG+H5EAVR6yOkNKhXWPA==',key_name='tempest-TestStampPattern-1512427519',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:31:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c666b56163d8480bb7977e63b2bb534a',ramdisk_id='',reservation_id='r-8hdyui03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-377185534',owner_user_name='tempest-TestStampPattern-377185534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:34:48Z,user_data=None,user_id='6a4098f7e8234722be739368cd364444',uuid=a16108af-bab9-4146-a928-4b2191f6f458,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converting VIF {"id": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "address": "fa:16:3e:d2:b2:50", "network": {"id": "6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6", "bridge": "br-int", "label": "tempest-TestStampPattern-722175384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c666b56163d8480bb7977e63b2bb534a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f7d9300-b2", "ovs_interfaceid": "8f7d9300-b2cb-4eed-a1d4-48f9ecfce446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b2:50,bridge_name='br-int',has_traffic_filtering=True,id=8f7d9300-b2cb-4eed-a1d4-48f9ecfce446,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f7d9300-b2') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG os_vif [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b2:50,bridge_name='br-int',has_traffic_filtering=True,id=8f7d9300-b2cb-4eed-a1d4-48f9ecfce446,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f7d9300-b2') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f7d9300-b2, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No VIF found with MAC fa:16:3e:1b:2b:b8, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08c7fa7f-6820-40a2-9539-666eed0a3af5) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:12 user nova-compute[74131]: INFO os_vif [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b2:50,bridge_name='br-int',has_traffic_filtering=True,id=8f7d9300-b2cb-4eed-a1d4-48f9ecfce446,network=Network(6b8fe233-9ef8-4f11-af9d-5ded7e7cc5b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f7d9300-b2')
Oct 20 16:39:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Deleting instance files /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458_del
Oct 20 16:39:12 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Deletion of /opt/stack/data/nova/instances/a16108af-bab9-4146-a928-4b2191f6f458_del complete
Oct 20 16:39:12 user nova-compute[74131]: INFO nova.compute.manager [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 16:39:12 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:39:12 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a16108af-bab9-4146-a928-4b2191f6f458] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:13 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Took 0.56 seconds to deallocate network for instance.
Oct 20 16:39:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa689406-fa25-4636-a20d-dcb6d54c3277 req-0d9e94cc-767d-4c0d-afcf-921a00a1ebac service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-vif-deleted-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:13 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Deleted allocations for instance a16108af-bab9-4146-a928-4b2191f6f458
Oct 20 16:39:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-55249bc4-9475-44ed-82cc-95ef3dfdf58a tempest-TestStampPattern-377185534 tempest-TestStampPattern-377185534-project-member] Lock "a16108af-bab9-4146-a928-4b2191f6f458" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received event network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] Acquiring lock "a16108af-bab9-4146-a928-4b2191f6f458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] Lock "a16108af-bab9-4146-a928-4b2191f6f458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] No waiting events found dispatching network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:14 user nova-compute[74131]: WARNING nova.compute.manager [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] [instance: a16108af-bab9-4146-a928-4b2191f6f458] Received unexpected event network-vif-plugged-8f7d9300-b2cb-4eed-a1d4-48f9ecfce446 for instance with vm_state deleted and task_state None.
Oct 20 16:39:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] Acquiring lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] No waiting events found dispatching network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:14 user nova-compute[74131]: WARNING nova.compute.manager [req-88204722-2825-4c6d-a226-cbb209e570ee req-7e588964-d571-4fd9-836a-e6f51a74ace0 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received unexpected event network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 for instance with vm_state building and task_state spawning.
Oct 20 16:39:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:39:15 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Instance spawned successfully.
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:39:16 user nova-compute[74131]: INFO nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 20 16:39:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:39:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-342a6597-fe75-4b99-80e0-49cddbb41a01 req-cc9a6878-4b55-4b3f-917b-ad6ff8ee55be service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-342a6597-fe75-4b99-80e0-49cddbb41a01 req-cc9a6878-4b55-4b3f-917b-ad6ff8ee55be service nova] Acquiring lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-342a6597-fe75-4b99-80e0-49cddbb41a01 req-cc9a6878-4b55-4b3f-917b-ad6ff8ee55be service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-342a6597-fe75-4b99-80e0-49cddbb41a01 req-cc9a6878-4b55-4b3f-917b-ad6ff8ee55be service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-342a6597-fe75-4b99-80e0-49cddbb41a01 req-cc9a6878-4b55-4b3f-917b-ad6ff8ee55be service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] No waiting events found dispatching network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:16 user nova-compute[74131]: WARNING nova.compute.manager [req-342a6597-fe75-4b99-80e0-49cddbb41a01 req-cc9a6878-4b55-4b3f-917b-ad6ff8ee55be service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received unexpected event network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 for instance with vm_state building and task_state spawning.
Oct 20 16:39:16 user nova-compute[74131]: INFO nova.compute.manager [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Took 26.03 seconds to build instance.
Oct 20 16:39:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c92098a0-cb87-4843-b7de-8563646cef03 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.152s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:23 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:23 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:23 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4260c96-8f01-42ac-a2b6-0a7d14bb7b8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:39:23 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bf438a-16a0-40f0-a3e8-d3f7e01a77e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28] added
Oct 20 16:39:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d0e4bf-4998-4081-833c-592ef8fc1e48]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2deb48-e8e5-49d7-a023-24f2e40822f9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rClImKHT {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rClImKHT" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[13de870a-5e01-4442-9acc-aeaa5e1c7542]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rClImKHT'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b377b4a-9f76-49bc-b38a-86137172ce71]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7319f6f-febe-40a0-b4a4-b0dc489b5ab8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac452b0-ef2e-452a-b48f-1427b903f99a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]
Oct 20 16:39:23 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1eb04c-5661-418e-9975-c4a76918d47e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df7458a-1c01-4a57-8441-d8433060c0e9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:39:23 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e7f553-71f0-4623-8615-e32159eb8b56]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:39:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23464333763663939', 'path': '/dev/sdg'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464333763663939', 'path': '/dev/sdg'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lazy-loading 'flavor' on Instance uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:39:24 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:39:24 user nova-compute[74131]:   <source dev="/dev/sdg"/>
Oct 20 16:39:24 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:39:24 user nova-compute[74131]:   <serial>5da99352-e9ec-4fc3-996f-e3e5c300bf28</serial>
Oct 20 16:39:24 user nova-compute[74131]: </disk>
Oct 20 16:39:24 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No VIF found with MAC fa:16:3e:45:39:ae, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:39:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7cbac016-3f20-4b8a-97ab-268e39499362 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.130s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Stashing vm_state: active {{(pid=74131) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:39:27 user nova-compute[74131]: INFO nova.compute.claims [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Claim successful on node user
Oct 20 16:39:27 user nova-compute[74131]: INFO nova.compute.resource_tracker [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating resource usage from migration 29dab3ae-144b-44d6-9d0d-774ca639f609
Oct 20 16:39:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.451s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:27 user nova-compute[74131]: INFO nova.compute.manager [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Migrating
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:27 user nova-compute[74131]: INFO nova.compute.rpcapi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Starting migrate_disk_and_power_off {{(pid=74131) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-c5a5636e-64f2-4807-90b3-3b73a0cb9956 req-a158a271-6ffa-4855-8c2a-841ab7cd017c service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c5a5636e-64f2-4807-90b3-3b73a0cb9956 req-a158a271-6ffa-4855-8c2a-841ab7cd017c service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c5a5636e-64f2-4807-90b3-3b73a0cb9956 req-a158a271-6ffa-4855-8c2a-841ab7cd017c service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c5a5636e-64f2-4807-90b3-3b73a0cb9956 req-a158a271-6ffa-4855-8c2a-841ab7cd017c service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG nova.compute.manager [req-c5a5636e-64f2-4807-90b3-3b73a0cb9956 req-a158a271-6ffa-4855-8c2a-841ab7cd017c service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:28 user nova-compute[74131]: WARNING nova.compute.manager [req-c5a5636e-64f2-4807-90b3-3b73a0cb9956 req-a158a271-6ffa-4855-8c2a-841ab7cd017c service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state active and task_state resize_migrating.
Oct 20 16:39:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:29 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance destroyed successfully.
Oct 20 16:39:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1525528198-network", "vif_mac": "fa:16:3e:45:39:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1525528198-network", "vif_mac": "fa:16:3e:45:39:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_vif [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e64e14-ac, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=762e7e94-8c9c-4316-bd56-58e701b7e151) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:29 user nova-compute[74131]: INFO os_vif [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac')
Oct 20 16:39:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:29 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5f779a-8829-431a-ab64-b1af077e9935]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:39:29 user nova-compute[74131]: No targets found.
Oct 20 16:39:29 user nova-compute[74131]: iSNS:
Oct 20 16:39:29 user nova-compute[74131]: No targets found.
Oct 20 16:39:29 user nova-compute[74131]: STATIC:
Oct 20 16:39:29 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:39:29 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:29 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:29 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28
Oct 20 16:39:29 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:29 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:29 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:39:29 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:29 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:29 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:39:29 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:29 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:29 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf
Oct 20 16:39:29 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:29 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:29 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:39:29 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:29 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:29 user nova-compute[74131]: FIRMWARE:
Oct 20 16:39:29 user nova-compute[74131]: No targets found.
Oct 20 16:39:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:39:29 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:39:29 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[07937d58-e616-4e2c-a367-00176aa47d9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc044a-720a-450d-a786-c31b794635a6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:39:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c86d95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28'): ({'sdg'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Removing single pathed devices sdg {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[95620337-be8e-448a-a048-83cd03189c90]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[056b9bd3-28b5-402f-b766-6d0ce1ed8175]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flushing IO for device /dev/sdg {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddcf4e5-7809-4070-a80b-1b8f116aeefd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c2aa01-14a5-4aae-878d-9a49acba587a]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] SCSI volumes sdg have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2ffb9-0e93-4f3e-8424-7b6a7ffaa84f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e46746-0f16-4819-abd1-0ff45969aaed]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]
Oct 20 16:39:29 user nova-compute[74131]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d352d131-0c41-49a6-9d8c-03e0a931699c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== disconnect_volume: return (341ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d_resize/disk /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "cp -r /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d_resize/disk /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk" returned: 0 in 0.296s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d_resize/disk.info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk.info {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "cp -r /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d_resize/disk.info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk.info" returned: 0 in 0.033s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-44d3fedf-42e7-40c0-8f1f-38276a118472 req-bd6b12ae-6a9b-4dc5-afce-4e01aeacf44f service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-44d3fedf-42e7-40c0-8f1f-38276a118472 req-bd6b12ae-6a9b-4dc5-afce-4e01aeacf44f service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-44d3fedf-42e7-40c0-8f1f-38276a118472 req-bd6b12ae-6a9b-4dc5-afce-4e01aeacf44f service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-44d3fedf-42e7-40c0-8f1f-38276a118472 req-bd6b12ae-6a9b-4dc5-afce-4e01aeacf44f service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-44d3fedf-42e7-40c0-8f1f-38276a118472 req-bd6b12ae-6a9b-4dc5-afce-4e01aeacf44f service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:30 user nova-compute[74131]: WARNING nova.compute.manager [req-44d3fedf-42e7-40c0-8f1f-38276a118472 req-bd6b12ae-6a9b-4dc5-afce-4e01aeacf44f service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state active and task_state resize_migrating.
Oct 20 16:39:31 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Port f5e64e14-ac02-4600-ac9b-9fa85e263786 binding to destination host user is already ACTIVE {{(pid=74131) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 20 16:39:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:31 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG os_brick.utils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d985a8-b4d1-4889-adf9-58bbb251d406]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f84848-361e-4d9d-b226-7ab32e8f30c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a58401-eec3-4a28-9ac7-4ec83b148f3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f387524-70d9-4e6c-8fce-a22825ee0af7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:39:32 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:39:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[357a820c-fa50-44a1-9a19-ac4bb69cdd43]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:39:32 user nova-compute[74131]: DEBUG os_brick.utils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:33 user nova-compute[74131]: INFO nova.compute.manager [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Terminating instance
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-76defbfa-663b-4edd-8ce8-e5ad5b88be9f req-f88bd501-331c-4192-90bc-df69fbf74d11 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-unplugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-76defbfa-663b-4edd-8ce8-e5ad5b88be9f req-f88bd501-331c-4192-90bc-df69fbf74d11 service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-76defbfa-663b-4edd-8ce8-e5ad5b88be9f req-f88bd501-331c-4192-90bc-df69fbf74d11 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-76defbfa-663b-4edd-8ce8-e5ad5b88be9f req-f88bd501-331c-4192-90bc-df69fbf74d11 service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-76defbfa-663b-4edd-8ce8-e5ad5b88be9f req-f88bd501-331c-4192-90bc-df69fbf74d11 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-unplugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-76defbfa-663b-4edd-8ce8-e5ad5b88be9f req-f88bd501-331c-4192-90bc-df69fbf74d11 service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-unplugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Skipping network cache update for instance because it is being deleted. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 46c22ead-b9e5-4f15-8a36-f62c56dd5977 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Instance destroyed successfully.
Oct 20 16:39:33 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lazy-loading 'resources' on Instance uuid e30f3de0-f564-4c73-9d9f-7292ceab83b1 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T16:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949739455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949739455',id=30,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ZqviLSokViG2Q1GMcg2v0NA1/0InAjTVojMUxsKDqWU2ZFjY5eQaj/XwReZeMLvlcK3up1KwckNZkxN9ZHxwPiScuEKI1kfjb66N+FAbroZx55XGQ8tn2qE1a/rx6GA==',key_name='tempest-keypair-2111111205',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:37:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02e81e0cc8c84c22bcb419d79a119364',ramdisk_id='',reservation_id='r-95zxp0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-189572795',owner_user_name='tempest-AttachVolumeShelveTestJSON-189572795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501cfb16d7aa4ef78ea393a53b7aa555',uuid=e30f3de0-f564-4c73-9d9f-7292ceab83b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converting VIF {"id": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "address": "fa:16:3e:9c:93:f1", "network": {"id": "3fc82a69-4958-4745-8eb8-9298264a5f41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1415503329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02e81e0cc8c84c22bcb419d79a119364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7757fa8-59", "ovs_interfaceid": "a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG os_vif [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7757fa8-59, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d3fbf78-5014-4161-aac6-06227eccfe2c) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:34 user nova-compute[74131]: INFO os_vif [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:93:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee,network=Network(3fc82a69-4958-4745-8eb8-9298264a5f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7757fa8-59')
Oct 20 16:39:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Deleting instance files /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1_del
Oct 20 16:39:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Deletion of /opt/stack/data/nova/instances/e30f3de0-f564-4c73-9d9f-7292ceab83b1_del complete
Oct 20 16:39:34 user nova-compute[74131]: INFO nova.compute.manager [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-changed-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Refreshing instance network info cache due to event network-changed-ed1b4ad7-52eb-432e-877f-4430254707c3. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] Acquiring lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] Acquired lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Refreshing network info cache for port ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updated VIF entry in instance network info cache for port ed1b4ad7-52eb-432e-877f-4430254707c3. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [{"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3b59fc89-a929-4e35-b50d-a11c3f76cbe8 req-a7cc73b1-b86f-4800-a29e-803871a60fae service nova] Releasing lock "refresh_cache-46c22ead-b9e5-4f15-8a36-f62c56dd5977" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:35 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Took 0.91 seconds to deallocate network for instance.
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:35 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Deleted allocations for instance e30f3de0-f564-4c73-9d9f-7292ceab83b1
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-0aaa7b6d-3e0f-4cd8-8939-ae5cc3e7aed4 req-cd47f946-144d-4e52-a8e5-60b9807dc96f service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0aaa7b6d-3e0f-4cd8-8939-ae5cc3e7aed4 req-cd47f946-144d-4e52-a8e5-60b9807dc96f service nova] Acquiring lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0aaa7b6d-3e0f-4cd8-8939-ae5cc3e7aed4 req-cd47f946-144d-4e52-a8e5-60b9807dc96f service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0aaa7b6d-3e0f-4cd8-8939-ae5cc3e7aed4 req-cd47f946-144d-4e52-a8e5-60b9807dc96f service nova] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-0aaa7b6d-3e0f-4cd8-8939-ae5cc3e7aed4 req-cd47f946-144d-4e52-a8e5-60b9807dc96f service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] No waiting events found dispatching network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:35 user nova-compute[74131]: WARNING nova.compute.manager [req-0aaa7b6d-3e0f-4cd8-8939-ae5cc3e7aed4 req-cd47f946-144d-4e52-a8e5-60b9807dc96f service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received unexpected event network-vif-plugged-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee for instance with vm_state deleted and task_state None.
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-0aaa7b6d-3e0f-4cd8-8939-ae5cc3e7aed4 req-cd47f946-144d-4e52-a8e5-60b9807dc96f service nova] [instance: e30f3de0-f564-4c73-9d9f-7292ceab83b1] Received event network-vif-deleted-a7757fa8-59e5-4081-a2ec-f4dbb7e1eeee {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Stashing vm_state: active {{(pid=74131) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0fa57553-2144-43f3-b095-a10dbfc48c15 tempest-AttachVolumeShelveTestJSON-189572795 tempest-AttachVolumeShelveTestJSON-189572795-project-member] Lock "e30f3de0-f564-4c73-9d9f-7292ceab83b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:39:36 user nova-compute[74131]: INFO nova.compute.claims [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Claim successful on node user
Oct 20 16:39:36 user nova-compute[74131]: INFO nova.compute.resource_tracker [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating resource usage from migration d859f1ba-9352-45fd-97ec-642606b74188
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-changed-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Refreshing instance network info cache due to event network-changed-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] Acquiring lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] Acquired lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Refreshing network info cache for port ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.864s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:36 user nova-compute[74131]: INFO nova.compute.manager [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Migrating
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.network.neutron [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updated VIF entry in instance network info cache for port ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.network.neutron [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bfecad98-65ee-4e31-a115-785f9a0296ac req-9b875963-e5a1-4fbf-9937-c7930edd40a6 service nova] Releasing lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquired lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7748MB free_disk=24.956249237060547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Applying migration context for instance 1d3dfe2f-845f-48fa-832b-58335159fd2d as it has an incoming, in-progress migration 29dab3ae-144b-44d6-9d0d-774ca639f609. Migration status is post-migrating {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Applying migration context for instance 8915ee60-7b51-465d-ba63-c933e26c8a68 as it has an incoming, in-progress migration d859f1ba-9352-45fd-97ec-642606b74188. Migration status is pre-migrating {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 16:39:37 user nova-compute[74131]: INFO nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating resource usage from migration 29dab3ae-144b-44d6-9d0d-774ca639f609
Oct 20 16:39:37 user nova-compute[74131]: INFO nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating resource usage from migration d859f1ba-9352-45fd-97ec-642606b74188
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e20dc23f-56e8-4800-89a0-b93db4520e1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d2d6ed79-93cb-4689-8ea2-46daf90a65c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Migration 29dab3ae-144b-44d6-9d0d-774ca639f609 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Migration d859f1ba-9352-45fd-97ec-642606b74188 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 8915ee60-7b51-465d-ba63-c933e26c8a68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:39:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Releasing lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Starting migrate_disk_and_power_off {{(pid=74131) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-3b2329e6-6a0f-4f54-8f1a-12ce0ab4444c req-e95d4003-06f2-43ec-8a9c-53f5bcc9f2a9 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-unplugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3b2329e6-6a0f-4f54-8f1a-12ce0ab4444c req-e95d4003-06f2-43ec-8a9c-53f5bcc9f2a9 service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3b2329e6-6a0f-4f54-8f1a-12ce0ab4444c req-e95d4003-06f2-43ec-8a9c-53f5bcc9f2a9 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3b2329e6-6a0f-4f54-8f1a-12ce0ab4444c req-e95d4003-06f2-43ec-8a9c-53f5bcc9f2a9 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG nova.compute.manager [req-3b2329e6-6a0f-4f54-8f1a-12ce0ab4444c req-e95d4003-06f2-43ec-8a9c-53f5bcc9f2a9 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-unplugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:38 user nova-compute[74131]: WARNING nova.compute.manager [req-3b2329e6-6a0f-4f54-8f1a-12ce0ab4444c req-e95d4003-06f2-43ec-8a9c-53f5bcc9f2a9 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received unexpected event network-vif-unplugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with vm_state active and task_state resize_migrating.
Oct 20 16:39:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance destroyed successfully.
Oct 20 16:39:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-8210013',display_name='tempest-ServerActionsTestOtherA-server-8210013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-8210013',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8iuw0r7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=8915ee60-7b51-465d-ba63-c933e26c8a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-491104535-network", "vif_mac": "fa:16:3e:31:21:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-491104535-network", "vif_mac": "fa:16:3e:31:21:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_vif [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef823c6f-ea, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ae9e390-5cae-4b82-b1ac-263c13a9d462) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:39 user nova-compute[74131]: INFO os_vif [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea')
Oct 20 16:39:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:39 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[76739d6c-df6b-4d53-b1b8-ac92aa994b27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:39:39 user nova-compute[74131]: No targets found.
Oct 20 16:39:39 user nova-compute[74131]: iSNS:
Oct 20 16:39:39 user nova-compute[74131]: No targets found.
Oct 20 16:39:39 user nova-compute[74131]: STATIC:
Oct 20 16:39:39 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:39:39 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:39 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:39 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:39:39 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:39 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:39 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:39:39 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:39 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:39 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf
Oct 20 16:39:39 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:39 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:39 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:39:39 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:39 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:39 user nova-compute[74131]: FIRMWARE:
Oct 20 16:39:39 user nova-compute[74131]: No targets found.
Oct 20 16:39:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:39:39 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:39:39 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57a47b1-c5f3-4805-8057-e6e188640840]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27fa558-bf81-4862-b126-b93a5b641603]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:39 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c81f1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2'): ({'sdd'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Removing single pathed devices sdd {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac0016c-097e-4e39-acab-27c3859f1c9d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[91340723-ba41-490a-b566-d98cb2b62b42]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flushing IO for device /dev/sdd {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[825cd41b-312b-40d6-b6c0-badc099070de]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8fe73-a396-4991-b281-ac12267981b9]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7048f380-982f67d183ef7bce', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7048f380', '/dev/disk/by-id/scsi-23938326636376431') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a998102-16cd-4a69-a36a-9f12213e4dcc]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f333d20e-62d7-44a0-ab37-b53bc4cee9e9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0f610b-0d41-4cdd-ae53-0300cb40e677]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]
Oct 20 16:39:39 user nova-compute[74131]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:39 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a02799-3d3a-4116-8d8b-bc0f74cab11f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== disconnect_volume: return (334ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:39:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-e983a97a-0789-494d-b853-845b79caac59 req-e33c9af5-3396-437c-9058-40a37e473b12 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e983a97a-0789-494d-b853-845b79caac59 req-e33c9af5-3396-437c-9058-40a37e473b12 service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e983a97a-0789-494d-b853-845b79caac59 req-e33c9af5-3396-437c-9058-40a37e473b12 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e983a97a-0789-494d-b853-845b79caac59 req-e33c9af5-3396-437c-9058-40a37e473b12 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-e983a97a-0789-494d-b853-845b79caac59 req-e33c9af5-3396-437c-9058-40a37e473b12 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:40 user nova-compute[74131]: WARNING nova.compute.manager [req-e983a97a-0789-494d-b853-845b79caac59 req-e33c9af5-3396-437c-9058-40a37e473b12 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received unexpected event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with vm_state active and task_state resize_migrating.
Oct 20 16:39:40 user nova-compute[74131]: DEBUG nova.network.neutron [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Port ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce binding to destination host user is already ACTIVE {{(pid=74131) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquired lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:40 user nova-compute[74131]: DEBUG nova.network.neutron [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG nova.network.neutron [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Releasing lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG os_brick.utils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf640aa-aa4e-4be9-bd3b-76a28ee6990e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e014b8-52a8-46ff-9184-accff0fbd04b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[26797989-13ee-4199-9a15-dc59807c7067]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbd8619-9594-457c-9989-394d51c24efa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:39:41 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:39:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad3ebd3-1238-4e71-8c67-ae2549b58ea3]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:39:41 user nova-compute[74131]: DEBUG os_brick.utils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:39:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:44 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquired lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'info_cache' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Releasing lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance destroyed successfully.
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'resources' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:37:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_vif [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap334ce2d7-c6, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=349000cb-71eb-4987-b402-e9779500b4cb) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:45 user nova-compute[74131]: INFO os_vif [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6')
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVXJFpHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8c34c-db2a-4f95-adc0-16e643b80db9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:39:45 user nova-compute[74131]: No targets found.
Oct 20 16:39:45 user nova-compute[74131]: iSNS:
Oct 20 16:39:45 user nova-compute[74131]: No targets found.
Oct 20 16:39:45 user nova-compute[74131]: STATIC:
Oct 20 16:39:45 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:39:45 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:45 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:45 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:39:45 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:45 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:45 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf
Oct 20 16:39:45 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:45 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:45 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:39:45 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:39:45 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:39:45 user nova-compute[74131]: FIRMWARE:
Oct 20 16:39:45 user nova-compute[74131]: No targets found.
Oct 20 16:39:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:39:45 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:39:45 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b10752d-b0e1-407e-b076-abafe7af6440]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6325f3bf-7ea1-4480-a9a1-f030128fbe10]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:45 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:45 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:45 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:45 user nova-compute[74131]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:45 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:45 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c81f37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4864a3-659c-4a17-8ddf-ed4dd019cb14]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1e04e0-5ef2-4198-98e8-6bbcf8aa8d94]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cedeb62-78a2-416e-a8db-a14671769c28]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2407f628-05d3-4bee-b374-4e72e24907bc]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c19fce-db02-4a4b-b287-8c53c359f5f0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6b0ed-ec34-4556-a8ea-f5b7591cd052]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]
Oct 20 16:39:45 user nova-compute[74131]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde52da4-e767-4232-9530-e2928d4344c8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== disconnect_volume: return (304ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Start _get_guest_xml network_info=[{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f6ff6ee7-6cca-4aa4-bc91-b787ec6a606e', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVXJFpHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f77f165e-a8f0-4352-b8d0-bb48cf325369', 'attached_at': '', 'detached_at': '', 'volume_id': '843400db-b249-47fd-ac36-0396f0a933cf', 'serial': '843400db-b249-47fd-ac36-0396f0a933cf'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'numa_topology' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:39:45 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:45 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'vcpu_model' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.objects.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVXJFpHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:45 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:45 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f131d7-d71a-462e-aa72-f41823317fed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:39:45 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3243e6c8-46b1-4c40-882a-544ea8c8bdcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf] added
Oct 20 16:39:45 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6723635-2b56-4bf9-8875-1ad87fa8741f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b9da6-d825-423e-b418-dfbcf6e8f281]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVXJFpHu {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVXJFpHu" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d4ef1-fecd-4fbc-97ef-9a106c12c663]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVXJFpHu'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb820c8-41bd-4f56-94d5-01f00c90507c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cdef50-96a1-424b-9c97-b5b01ac51b44]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a7e2b1-bb11-4184-9c33-47749a6ef426]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]
Oct 20 16:39:46 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0ee894-29dc-4c2e-b771-b686d7444b15]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fabbc3-e404-4324-8e16-785a4486e574]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:46 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:46 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e7530a-18d7-4d56-8ae5-36b0610a457d]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:46 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVXJFpHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23862653137663532', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862653137663532', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:37:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'pci_devices' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.objects.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:39:47 user nova-compute[74131]:   <uuid>f77f165e-a8f0-4352-b8d0-bb48cf325369</uuid>
Oct 20 16:39:47 user nova-compute[74131]:   <name>instance-00000023</name>
Oct 20 16:39:47 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:39:47 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:39:47 user nova-compute[74131]:   <metadata>
Oct 20 16:39:47 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:39:47 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:39:47 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeTestJSON-server-57709410</nova:name>
Oct 20 16:39:47 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:39:45</nova:creationTime>
Oct 20 16:39:47 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:39:47 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:39:47 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:39:47 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:39:47 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:39:47 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:39:47 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:39:47 user nova-compute[74131]:       <nova:owner>
Oct 20 16:39:47 user nova-compute[74131]:         <nova:user uuid="fea2a757da8e46dda15f3e996a94940f">tempest-AttachVolumeTestJSON-791392427-project-member</nova:user>
Oct 20 16:39:47 user nova-compute[74131]:         <nova:project uuid="7795f458a4c844238e9dece3464d4b69">tempest-AttachVolumeTestJSON-791392427</nova:project>
Oct 20 16:39:47 user nova-compute[74131]:       </nova:owner>
Oct 20 16:39:47 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:39:47 user nova-compute[74131]:       <nova:ports>
Oct 20 16:39:47 user nova-compute[74131]:         <nova:port uuid="334ce2d7-c655-430b-8c98-25c37e643e6a">
Oct 20 16:39:47 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:39:47 user nova-compute[74131]:         </nova:port>
Oct 20 16:39:47 user nova-compute[74131]:       </nova:ports>
Oct 20 16:39:47 user nova-compute[74131]:     </nova:instance>
Oct 20 16:39:47 user nova-compute[74131]:   </metadata>
Oct 20 16:39:47 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:39:47 user nova-compute[74131]:     <system>
Oct 20 16:39:47 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:39:47 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:39:47 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:39:47 user nova-compute[74131]:       <entry name="serial">f77f165e-a8f0-4352-b8d0-bb48cf325369</entry>
Oct 20 16:39:47 user nova-compute[74131]:       <entry name="uuid">f77f165e-a8f0-4352-b8d0-bb48cf325369</entry>
Oct 20 16:39:47 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:39:47 user nova-compute[74131]:     </system>
Oct 20 16:39:47 user nova-compute[74131]:   </sysinfo>
Oct 20 16:39:47 user nova-compute[74131]:   <os>
Oct 20 16:39:47 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:39:47 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:39:47 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:39:47 user nova-compute[74131]:   </os>
Oct 20 16:39:47 user nova-compute[74131]:   <features>
Oct 20 16:39:47 user nova-compute[74131]:     <acpi/>
Oct 20 16:39:47 user nova-compute[74131]:     <apic/>
Oct 20 16:39:47 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:39:47 user nova-compute[74131]:   </features>
Oct 20 16:39:47 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:39:47 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:39:47 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:39:47 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:39:47 user nova-compute[74131]:   </clock>
Oct 20 16:39:47 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:39:47 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:39:47 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:39:47 user nova-compute[74131]:   </cpu>
Oct 20 16:39:47 user nova-compute[74131]:   <devices>
Oct 20 16:39:47 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:39:47 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:39:47 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk"/>
Oct 20 16:39:47 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:39:47 user nova-compute[74131]:     </disk>
Oct 20 16:39:47 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:39:47 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:39:47 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 16:39:47 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:39:47 user nova-compute[74131]:       <serial>843400db-b249-47fd-ac36-0396f0a933cf</serial>
Oct 20 16:39:47 user nova-compute[74131]:     </disk>
Oct 20 16:39:47 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:39:47 user nova-compute[74131]:       <mac address="fa:16:3e:28:94:04"/>
Oct 20 16:39:47 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:47 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:39:47 user nova-compute[74131]:       <target dev="tap334ce2d7-c6"/>
Oct 20 16:39:47 user nova-compute[74131]:     </interface>
Oct 20 16:39:47 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:39:47 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/console.log" append="off"/>
Oct 20 16:39:47 user nova-compute[74131]:     </serial>
Oct 20 16:39:47 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:39:47 user nova-compute[74131]:     <video>
Oct 20 16:39:47 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:47 user nova-compute[74131]:     </video>
Oct 20 16:39:47 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:39:47 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:39:47 user nova-compute[74131]:     </rng>
Oct 20 16:39:47 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:39:47 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:39:47 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:39:47 user nova-compute[74131]:     </memballoon>
Oct 20 16:39:47 user nova-compute[74131]:   </devices>
Oct 20 16:39:47 user nova-compute[74131]: </domain>
Oct 20 16:39:47 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'trusted_certs' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.objects.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:39:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Cannot resize image /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'migration_context' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG nova.objects.base [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:37:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG os_vif [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f89ea0-f2fc-5622-bff6-65b8cb764fa9', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap334ce2d7-c6, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap334ce2d7-c6, col_values=(('qos', UUID('83182ec0-d1ee-4959-9f9d-fed7276dd9a8')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap334ce2d7-c6, col_values=(('external_ids', {'iface-id': '334ce2d7-c655-430b-8c98-25c37e643e6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:94:04', 'vm-uuid': 'f77f165e-a8f0-4352-b8d0-bb48cf325369'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:48 user nova-compute[74131]: INFO os_vif [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6')
Oct 20 16:39:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-015feac2-23df-4fda-9fbb-bc4c7e575148 req-538f5aba-7730-4cd4-916e-fa96ba655bdb service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-015feac2-23df-4fda-9fbb-bc4c7e575148 req-538f5aba-7730-4cd4-916e-fa96ba655bdb service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-015feac2-23df-4fda-9fbb-bc4c7e575148 req-538f5aba-7730-4cd4-916e-fa96ba655bdb service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-015feac2-23df-4fda-9fbb-bc4c7e575148 req-538f5aba-7730-4cd4-916e-fa96ba655bdb service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-015feac2-23df-4fda-9fbb-bc4c7e575148 req-538f5aba-7730-4cd4-916e-fa96ba655bdb service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:49 user nova-compute[74131]: WARNING nova.compute.manager [req-015feac2-23df-4fda-9fbb-bc4c7e575148 req-538f5aba-7730-4cd4-916e-fa96ba655bdb service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state stopped and task_state powering-on.
Oct 20 16:39:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Starting finish_migration {{(pid=74131) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:39:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Creating image(s)
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk. size=21474836480 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk 21474836480 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk 21474836480" returned: 0 in 0.043s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Ensure instance console log exists: /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Start _get_guest_xml network_info=[{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1525528198-network", "vif_mac": "fa:16:3e:45:39:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9c922296-d8de-4460-a520-1eca2d8f2b0c', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1d3dfe2f-845f-48fa-832b-58335159fd2d', 'attached_at': '2023-10-20T16:39:50.000000', 'detached_at': '', 'volume_id': '5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'serial': '5da99352-e9ec-4fc3-996f-e3e5c300bf28'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:39:50 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:50 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:39:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:39:50 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:51 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:39:51 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b43cdf4-af84-473a-acfa-f439725412ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:39:51 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[312364a6-a2bb-46a8-9519-8212eae7dc65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28] added
Oct 20 16:39:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5348e-d7ab-4fa0-bfcd-cbf7614962e9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac83979-b837-4c17-80dc-9bfd38252257]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rClImKHT {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rClImKHT" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6cbc1-1bf2-4920-8112-d1e629633a7c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rClImKHT'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90dd2e3-cd8f-4d06-b4d4-427803e4b284]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6596a0-2a67-4346-a3f5-2adffda7dbf5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37a208e-eeac-49d2-bcb9-757a3439f71c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]
Oct 20 16:39:51 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.
Oct 20 16:39:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0374ce0c-62bd-49d0-85cd-536616cb2da5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ff7286-992b-478a-8205-434fc44fc726]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:39:51 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:39:51 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021b3ad-0531-4835-849c-c4c31faa56f6]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:39:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance rebooted successfully.
Oct 20 16:39:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-bfa12246-74c0-4c1d-8734-ea157f05a4a5 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-bdb0697c-0d00-4e11-9904-85b3df8ba003 req-cb04f948-4cba-4d38-84cc-5d13730342de service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bdb0697c-0d00-4e11-9904-85b3df8ba003 req-cb04f948-4cba-4d38-84cc-5d13730342de service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bdb0697c-0d00-4e11-9904-85b3df8ba003 req-cb04f948-4cba-4d38-84cc-5d13730342de service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bdb0697c-0d00-4e11-9904-85b3df8ba003 req-cb04f948-4cba-4d38-84cc-5d13730342de service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-bdb0697c-0d00-4e11-9904-85b3df8ba003 req-cb04f948-4cba-4d38-84cc-5d13730342de service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:51 user nova-compute[74131]: WARNING nova.compute.manager [req-bdb0697c-0d00-4e11-9904-85b3df8ba003 req-cb04f948-4cba-4d38-84cc-5d13730342de service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state stopped and task_state powering-on.
Oct 20 16:39:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23464333763663939', 'path': '/dev/sdd'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464333763663939', 'path': '/dev/sdd'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1525528198-network", "vif_mac": "fa:16:3e:45:39:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1525528198-network", "vif_mac": "fa:16:3e:45:39:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:39:52 user nova-compute[74131]:   <uuid>1d3dfe2f-845f-48fa-832b-58335159fd2d</uuid>
Oct 20 16:39:52 user nova-compute[74131]:   <name>instance-00000021</name>
Oct 20 16:39:52 user nova-compute[74131]:   <memory>2097152</memory>
Oct 20 16:39:52 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:39:52 user nova-compute[74131]:   <metadata>
Oct 20 16:39:52 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:39:52 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:39:52 user nova-compute[74131]:       <nova:name>tempest-ServerActionsTestOtherB-server-593432805</nova:name>
Oct 20 16:39:52 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:39:50</nova:creationTime>
Oct 20 16:39:52 user nova-compute[74131]:       <nova:flavor name="m1.small">
Oct 20 16:39:52 user nova-compute[74131]:         <nova:memory>2048</nova:memory>
Oct 20 16:39:52 user nova-compute[74131]:         <nova:disk>20</nova:disk>
Oct 20 16:39:52 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:39:52 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:39:52 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:39:52 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:39:52 user nova-compute[74131]:       <nova:owner>
Oct 20 16:39:52 user nova-compute[74131]:         <nova:user uuid="43f5b83594714d9b88c1ba68c6dbf532">tempest-ServerActionsTestOtherB-915456315-project-member</nova:user>
Oct 20 16:39:52 user nova-compute[74131]:         <nova:project uuid="75a52cd8d5604e8bb772e88a6e524385">tempest-ServerActionsTestOtherB-915456315</nova:project>
Oct 20 16:39:52 user nova-compute[74131]:       </nova:owner>
Oct 20 16:39:52 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:39:52 user nova-compute[74131]:       <nova:ports>
Oct 20 16:39:52 user nova-compute[74131]:         <nova:port uuid="f5e64e14-ac02-4600-ac9b-9fa85e263786">
Oct 20 16:39:52 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:39:52 user nova-compute[74131]:         </nova:port>
Oct 20 16:39:52 user nova-compute[74131]:       </nova:ports>
Oct 20 16:39:52 user nova-compute[74131]:     </nova:instance>
Oct 20 16:39:52 user nova-compute[74131]:   </metadata>
Oct 20 16:39:52 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:39:52 user nova-compute[74131]:     <system>
Oct 20 16:39:52 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:39:52 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:39:52 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:39:52 user nova-compute[74131]:       <entry name="serial">1d3dfe2f-845f-48fa-832b-58335159fd2d</entry>
Oct 20 16:39:52 user nova-compute[74131]:       <entry name="uuid">1d3dfe2f-845f-48fa-832b-58335159fd2d</entry>
Oct 20 16:39:52 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:39:52 user nova-compute[74131]:     </system>
Oct 20 16:39:52 user nova-compute[74131]:   </sysinfo>
Oct 20 16:39:52 user nova-compute[74131]:   <os>
Oct 20 16:39:52 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:39:52 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:39:52 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:39:52 user nova-compute[74131]:   </os>
Oct 20 16:39:52 user nova-compute[74131]:   <features>
Oct 20 16:39:52 user nova-compute[74131]:     <acpi/>
Oct 20 16:39:52 user nova-compute[74131]:     <apic/>
Oct 20 16:39:52 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:39:52 user nova-compute[74131]:   </features>
Oct 20 16:39:52 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:39:52 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:39:52 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:39:52 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:39:52 user nova-compute[74131]:   </clock>
Oct 20 16:39:52 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:39:52 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:39:52 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:39:52 user nova-compute[74131]:   </cpu>
Oct 20 16:39:52 user nova-compute[74131]:   <devices>
Oct 20 16:39:52 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:39:52 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:39:52 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk"/>
Oct 20 16:39:52 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:39:52 user nova-compute[74131]:     </disk>
Oct 20 16:39:52 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:39:52 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:39:52 user nova-compute[74131]:       <source dev="/dev/sdd"/>
Oct 20 16:39:52 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:39:52 user nova-compute[74131]:       <serial>5da99352-e9ec-4fc3-996f-e3e5c300bf28</serial>
Oct 20 16:39:52 user nova-compute[74131]:     </disk>
Oct 20 16:39:52 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:39:52 user nova-compute[74131]:       <mac address="fa:16:3e:45:39:ae"/>
Oct 20 16:39:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:52 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:39:52 user nova-compute[74131]:       <target dev="tapf5e64e14-ac"/>
Oct 20 16:39:52 user nova-compute[74131]:     </interface>
Oct 20 16:39:52 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:39:52 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/console.log" append="off"/>
Oct 20 16:39:52 user nova-compute[74131]:     </serial>
Oct 20 16:39:52 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:39:52 user nova-compute[74131]:     <video>
Oct 20 16:39:52 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:39:52 user nova-compute[74131]:     </video>
Oct 20 16:39:52 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:39:52 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:39:52 user nova-compute[74131]:     </rng>
Oct 20 16:39:52 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:39:52 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:39:52 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:39:52 user nova-compute[74131]:     </memballoon>
Oct 20 16:39:52 user nova-compute[74131]:   </devices>
Oct 20 16:39:52 user nova-compute[74131]: </domain>
Oct 20 16:39:52 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1525528198-network", "vif_mac": "fa:16:3e:45:39:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1525528198-network", "vif_mac": "fa:16:3e:45:39:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG os_vif [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1f92819-4927-51f3-887a-da0798ac76e5', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e64e14-ac, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e64e14-ac, col_values=(('qos', UUID('cfa456ab-459e-4c87-aff2-345b44426734')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e64e14-ac, col_values=(('external_ids', {'iface-id': 'f5e64e14-ac02-4600-ac9b-9fa85e263786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:39:ae', 'vm-uuid': '1d3dfe2f-845f-48fa-832b-58335159fd2d'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:39:52 user nova-compute[74131]: INFO os_vif [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac')
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:39:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] No VIF found with MAC fa:16:3e:45:39:ae, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-7a1e45c5-494f-4c18-bff7-65aadb27cc29 req-9e5c2930-dc1d-4cff-a9ff-c104cf4192da service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7a1e45c5-494f-4c18-bff7-65aadb27cc29 req-9e5c2930-dc1d-4cff-a9ff-c104cf4192da service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7a1e45c5-494f-4c18-bff7-65aadb27cc29 req-9e5c2930-dc1d-4cff-a9ff-c104cf4192da service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7a1e45c5-494f-4c18-bff7-65aadb27cc29 req-9e5c2930-dc1d-4cff-a9ff-c104cf4192da service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-7a1e45c5-494f-4c18-bff7-65aadb27cc29 req-9e5c2930-dc1d-4cff-a9ff-c104cf4192da service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:54 user nova-compute[74131]: WARNING nova.compute.manager [req-7a1e45c5-494f-4c18-bff7-65aadb27cc29 req-9e5c2930-dc1d-4cff-a9ff-c104cf4192da service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state active and task_state resize_finish.
Oct 20 16:39:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:39:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-2a285ed2-ef1a-462c-8146-cb0bbac9b019 req-7d4b225b-d80b-4316-b0b1-a8d366c7731d service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:39:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2a285ed2-ef1a-462c-8146-cb0bbac9b019 req-7d4b225b-d80b-4316-b0b1-a8d366c7731d service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:39:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2a285ed2-ef1a-462c-8146-cb0bbac9b019 req-7d4b225b-d80b-4316-b0b1-a8d366c7731d service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:39:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2a285ed2-ef1a-462c-8146-cb0bbac9b019 req-7d4b225b-d80b-4316-b0b1-a8d366c7731d service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:39:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-2a285ed2-ef1a-462c-8146-cb0bbac9b019 req-7d4b225b-d80b-4316-b0b1-a8d366c7731d service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:39:56 user nova-compute[74131]: WARNING nova.compute.manager [req-2a285ed2-ef1a-462c-8146-cb0bbac9b019 req-7d4b225b-d80b-4316-b0b1-a8d366c7731d service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state active and task_state resize_finish.
Oct 20 16:39:56 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:39:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance running successfully.
Oct 20 16:39:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Failed to set time: agent not configured {{(pid=74131) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 16:39:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c62d4b5c-8597-499b-b8b2-fa70c0dbada7 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] finish_migration finished successfully. {{(pid=74131) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 16:39:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Starting finish_migration {{(pid=74131) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:40:00 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Creating image(s)
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Ensure instance console log exists: /opt/stack/data/nova/instances/8915ee60-7b51-465d-ba63-c933e26c8a68/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Start _get_guest_xml network_info=[{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-491104535-network", "vif_mac": "fa:16:3e:31:21:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7b57fd90-e5ef-481c-89f3-929118304b5e', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8915ee60-7b51-465d-ba63-c933e26c8a68', 'attached_at': '2023-10-20T16:40:00.000000', 'detached_at': '', 'volume_id': '40281c46-e7a9-4cf0-af38-f885962d82c2', 'serial': '40281c46-e7a9-4cf0-af38-f885962d82c2'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:40:00 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:40:00 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:40:00 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:40:00 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:40:00 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e09d93-8129-40a5-943c-cfdbd1359a57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:40:00 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a3ee9a-2649-40eb-b0bb-1ef6f21d7c34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2] added
Oct 20 16:40:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b497b6-4587-46ad-b1a9-d58957b715a0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[df982588-7644-4b99-b0c9-4e48754de1cc]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqColfhI {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqColfhI" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd9236c-168e-4807-9098-3191e94833e3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BqColfhI'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b6bed-79f4-46e5-8552-2667d6cc553d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f2e69-fca5-4fd7-8030-688f3ce393bc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a13c631-d987-462b-bee1-3858a55e47d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]
Oct 20 16:40:00 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.
Oct 20 16:40:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042108d-0a1c-4755-a0c0-e63b6f2d4dd2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2564c76f-9d7f-4e10-88d8-4b107ba76933]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:40:00 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[46022d42-9df3-472a-bda3-197f60146d50]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:40:00 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23938326636376431', 'path': '/dev/sdg'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326636376431', 'path': '/dev/sdg'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-8210013',display_name='tempest-ServerActionsTestOtherA-server-8210013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-8210013',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8iuw0r7w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=8915ee60-7b51-465d-ba63-c933e26c8a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-491104535-network", "vif_mac": "fa:16:3e:31:21:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-491104535-network", "vif_mac": "fa:16:3e:31:21:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:40:01 user nova-compute[74131]:   <uuid>8915ee60-7b51-465d-ba63-c933e26c8a68</uuid>
Oct 20 16:40:01 user nova-compute[74131]:   <name>instance-00000025</name>
Oct 20 16:40:01 user nova-compute[74131]:   <memory>2097152</memory>
Oct 20 16:40:01 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:40:01 user nova-compute[74131]:   <metadata>
Oct 20 16:40:01 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:40:01 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:40:01 user nova-compute[74131]:       <nova:name>tempest-ServerActionsTestOtherA-server-8210013</nova:name>
Oct 20 16:40:01 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:40:00</nova:creationTime>
Oct 20 16:40:01 user nova-compute[74131]:       <nova:flavor name="m1.small">
Oct 20 16:40:01 user nova-compute[74131]:         <nova:memory>2048</nova:memory>
Oct 20 16:40:01 user nova-compute[74131]:         <nova:disk>20</nova:disk>
Oct 20 16:40:01 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:40:01 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:40:01 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:40:01 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:40:01 user nova-compute[74131]:       <nova:owner>
Oct 20 16:40:01 user nova-compute[74131]:         <nova:user uuid="2f6bff83a2e24a289333823acf911ccd">tempest-ServerActionsTestOtherA-844175334-project-member</nova:user>
Oct 20 16:40:01 user nova-compute[74131]:         <nova:project uuid="69db8a4e064f445abd0a8555aaa18b88">tempest-ServerActionsTestOtherA-844175334</nova:project>
Oct 20 16:40:01 user nova-compute[74131]:       </nova:owner>
Oct 20 16:40:01 user nova-compute[74131]:       <nova:ports>
Oct 20 16:40:01 user nova-compute[74131]:         <nova:port uuid="ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce">
Oct 20 16:40:01 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 16:40:01 user nova-compute[74131]:         </nova:port>
Oct 20 16:40:01 user nova-compute[74131]:       </nova:ports>
Oct 20 16:40:01 user nova-compute[74131]:     </nova:instance>
Oct 20 16:40:01 user nova-compute[74131]:   </metadata>
Oct 20 16:40:01 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:40:01 user nova-compute[74131]:     <system>
Oct 20 16:40:01 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:40:01 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:40:01 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:40:01 user nova-compute[74131]:       <entry name="serial">8915ee60-7b51-465d-ba63-c933e26c8a68</entry>
Oct 20 16:40:01 user nova-compute[74131]:       <entry name="uuid">8915ee60-7b51-465d-ba63-c933e26c8a68</entry>
Oct 20 16:40:01 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:40:01 user nova-compute[74131]:     </system>
Oct 20 16:40:01 user nova-compute[74131]:   </sysinfo>
Oct 20 16:40:01 user nova-compute[74131]:   <os>
Oct 20 16:40:01 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:40:01 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:40:01 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:40:01 user nova-compute[74131]:   </os>
Oct 20 16:40:01 user nova-compute[74131]:   <features>
Oct 20 16:40:01 user nova-compute[74131]:     <acpi/>
Oct 20 16:40:01 user nova-compute[74131]:     <apic/>
Oct 20 16:40:01 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:40:01 user nova-compute[74131]:   </features>
Oct 20 16:40:01 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:40:01 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:40:01 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:40:01 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:40:01 user nova-compute[74131]:   </clock>
Oct 20 16:40:01 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:40:01 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:40:01 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:40:01 user nova-compute[74131]:   </cpu>
Oct 20 16:40:01 user nova-compute[74131]:   <devices>
Oct 20 16:40:01 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:40:01 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:40:01 user nova-compute[74131]:       <source dev="/dev/sdg"/>
Oct 20 16:40:01 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:40:01 user nova-compute[74131]:       <serial>40281c46-e7a9-4cf0-af38-f885962d82c2</serial>
Oct 20 16:40:01 user nova-compute[74131]:     </disk>
Oct 20 16:40:01 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:40:01 user nova-compute[74131]:       <mac address="fa:16:3e:31:21:e2"/>
Oct 20 16:40:01 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:40:01 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:40:01 user nova-compute[74131]:       <target dev="tapef823c6f-ea"/>
Oct 20 16:40:01 user nova-compute[74131]:     </interface>
Oct 20 16:40:01 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:40:01 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/8915ee60-7b51-465d-ba63-c933e26c8a68/console.log" append="off"/>
Oct 20 16:40:01 user nova-compute[74131]:     </serial>
Oct 20 16:40:01 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:40:01 user nova-compute[74131]:     <video>
Oct 20 16:40:01 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:40:01 user nova-compute[74131]:     </video>
Oct 20 16:40:01 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:40:01 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:40:01 user nova-compute[74131]:     </rng>
Oct 20 16:40:01 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:40:01 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:40:01 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:40:01 user nova-compute[74131]:     </memballoon>
Oct 20 16:40:01 user nova-compute[74131]:   </devices>
Oct 20 16:40:01 user nova-compute[74131]: </domain>
Oct 20 16:40:01 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-8210013',display_name='tempest-ServerActionsTestOtherA-server-8210013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-8210013',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8iuw0r7w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=8915ee60-7b51-465d-ba63-c933e26c8a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-491104535-network", "vif_mac": "fa:16:3e:31:21:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-491104535-network", "vif_mac": "fa:16:3e:31:21:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG os_vif [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4f31e8e-33cd-599e-a19b-fe93e127001d', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef823c6f-ea, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef823c6f-ea, col_values=(('qos', UUID('26cbd460-2ec2-49de-9aa9-f2a52cc6606f')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef823c6f-ea, col_values=(('external_ids', {'iface-id': 'ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:21:e2', 'vm-uuid': '8915ee60-7b51-465d-ba63-c933e26c8a68'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:01 user nova-compute[74131]: INFO os_vif [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea')
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:40:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] No VIF found with MAC fa:16:3e:31:21:e2, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-9ee36e14-83c4-4d07-a779-48ccf11973ec req-d9901f5c-4311-448c-88d2-abbf0e8abf49 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ee36e14-83c4-4d07-a779-48ccf11973ec req-d9901f5c-4311-448c-88d2-abbf0e8abf49 service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ee36e14-83c4-4d07-a779-48ccf11973ec req-d9901f5c-4311-448c-88d2-abbf0e8abf49 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9ee36e14-83c4-4d07-a779-48ccf11973ec req-d9901f5c-4311-448c-88d2-abbf0e8abf49 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-9ee36e14-83c4-4d07-a779-48ccf11973ec req-d9901f5c-4311-448c-88d2-abbf0e8abf49 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:03 user nova-compute[74131]: WARNING nova.compute.manager [req-9ee36e14-83c4-4d07-a779-48ccf11973ec req-d9901f5c-4311-448c-88d2-abbf0e8abf49 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received unexpected event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with vm_state active and task_state resize_finish.
Oct 20 16:40:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-4161d0af-7586-404a-aef8-1bf72bd8eef2 req-87e46dbf-d7fa-48e8-83a3-456b25061617 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4161d0af-7586-404a-aef8-1bf72bd8eef2 req-87e46dbf-d7fa-48e8-83a3-456b25061617 service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4161d0af-7586-404a-aef8-1bf72bd8eef2 req-87e46dbf-d7fa-48e8-83a3-456b25061617 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4161d0af-7586-404a-aef8-1bf72bd8eef2 req-87e46dbf-d7fa-48e8-83a3-456b25061617 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-4161d0af-7586-404a-aef8-1bf72bd8eef2 req-87e46dbf-d7fa-48e8-83a3-456b25061617 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:05 user nova-compute[74131]: WARNING nova.compute.manager [req-4161d0af-7586-404a-aef8-1bf72bd8eef2 req-87e46dbf-d7fa-48e8-83a3-456b25061617 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received unexpected event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with vm_state active and task_state resize_finish.
Oct 20 16:40:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:40:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance running successfully.
Oct 20 16:40:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Failed to set time: agent not configured {{(pid=74131) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 16:40:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-31841f57-4474-484b-8f79-30aec99e8528 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] finish_migration finished successfully. {{(pid=74131) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 16:40:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:16 user nova-compute[74131]: INFO nova.compute.manager [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Rescuing
Oct 20 16:40:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:40:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:40:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:40:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Updating instance_info_cache with network_info: [{"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-60fb376d-b12f-43e1-bea3-dbc16a08ec42 req-c3d4e53e-d2d7-4148-9a2f-6e38df3f9bd1 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60fb376d-b12f-43e1-bea3-dbc16a08ec42 req-c3d4e53e-d2d7-4148-9a2f-6e38df3f9bd1 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60fb376d-b12f-43e1-bea3-dbc16a08ec42 req-c3d4e53e-d2d7-4148-9a2f-6e38df3f9bd1 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-60fb376d-b12f-43e1-bea3-dbc16a08ec42 req-c3d4e53e-d2d7-4148-9a2f-6e38df3f9bd1 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-60fb376d-b12f-43e1-bea3-dbc16a08ec42 req-c3d4e53e-d2d7-4148-9a2f-6e38df3f9bd1 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:17 user nova-compute[74131]: WARNING nova.compute.manager [req-60fb376d-b12f-43e1-bea3-dbc16a08ec42 req-c3d4e53e-d2d7-4148-9a2f-6e38df3f9bd1 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state active and task_state rescuing.
Oct 20 16:40:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance destroyed successfully.
Oct 20 16:40:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Attempting a stable device rescue
Oct 20 16:40:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74131) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 16:40:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:40:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Creating image(s)
Oct 20 16:40:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "/opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "/opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'trusted_certs' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "f32f7af4221d855baf684afeb7e6def276b5a601" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "f32f7af4221d855baf684afeb7e6def276b5a601" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG nova.virt.images [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] f2be11df-e6f3-4a4d-bcc4-01902b7c5717 was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.part /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-cec7fa5d-a4b4-46c3-9621-f7830c22d401 req-5fa5c972-e449-4a3d-b637-763ec68f4c58 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cec7fa5d-a4b4-46c3-9621-f7830c22d401 req-5fa5c972-e449-4a3d-b637-763ec68f4c58 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cec7fa5d-a4b4-46c3-9621-f7830c22d401 req-5fa5c972-e449-4a3d-b637-763ec68f4c58 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cec7fa5d-a4b4-46c3-9621-f7830c22d401 req-5fa5c972-e449-4a3d-b637-763ec68f4c58 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-cec7fa5d-a4b4-46c3-9621-f7830c22d401 req-5fa5c972-e449-4a3d-b637-763ec68f4c58 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:19 user nova-compute[74131]: WARNING nova.compute.manager [req-cec7fa5d-a4b4-46c3-9621-f7830c22d401 req-5fa5c972-e449-4a3d-b637-763ec68f4c58 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state active and task_state rescuing.
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.part /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.converted" returned: 0 in 0.620s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "f32f7af4221d855baf684afeb7e6def276b5a601" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.164s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "f32f7af4221d855baf684afeb7e6def276b5a601" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "f32f7af4221d855baf684afeb7e6def276b5a601" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601 --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601,backing_fmt=raw /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601,backing_fmt=raw /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue" returned: 0 in 0.057s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "f32f7af4221d855baf684afeb7e6def276b5a601" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.instance [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'migration_context' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<e20dc23f-56e8-4800-89a0-b93db4520e1d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Start _get_guest_xml network_info=[{"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "vif_mac": "fa:16:3e:f8:3a:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f2be11df-e6f3-4a4d-bcc4-01902b7c5717', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3e7c4a33-8b43-44b9-b2b7-e49309b3675d', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfcMoVWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e20dc23f-56e8-4800-89a0-b93db4520e1d', 'attached_at': '', 'detached_at': '', 'volume_id': '5d619add-e12e-42ae-af37-13bc337e37f4', 'serial': '5d619add-e12e-42ae-af37-13bc337e37f4'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.instance [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'resources' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<e20dc23f-56e8-4800-89a0-b93db4520e1d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.instance [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'numa_topology' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<e20dc23f-56e8-4800-89a0-b93db4520e1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:40:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:40:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.instance [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'vcpu_model' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<e20dc23f-56e8-4800-89a0-b93db4520e1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfcMoVWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:40:20 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:40:20 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:40:20 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b48a781-4658-4822-97f0-663062f41aeb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OfcMoVWK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 16:40:20 user nova-compute[74131]: node.name = iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:40:20 user nova-compute[74131]: node.tpgt = -1
Oct 20 16:40:20 user nova-compute[74131]: node.startup = automatic
Oct 20 16:40:20 user nova-compute[74131]: node.leading_login = No
Oct 20 16:40:20 user nova-compute[74131]: iface.iscsi_ifacename = default
Oct 20 16:40:20 user nova-compute[74131]: iface.net_ifacename = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.ipaddress = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.prefix_len = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.hwaddress = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.transport_name = tcp
Oct 20 16:40:20 user nova-compute[74131]: iface.initiatorname = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.state = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.vlan_id = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.vlan_priority = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.vlan_state = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.iface_num = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.mtu = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.port = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.bootproto = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.subnet_mask = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.gateway = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_alt_client_id = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_dns = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_learn_iqn = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_vendor_id_state = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_vendor_id = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.dhcp_slp_da = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.fragmentation = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.gratuitous_arp = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.incoming_forwarding = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.tos_state = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.tos = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.ttl = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.delayed_ack = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.tcp_nagle = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.tcp_wsf_state = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.tcp_wsf = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.tcp_timer_scale = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.tcp_timestamp = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.redirect = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.def_task_mgmt_timeout = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.header_digest = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.data_digest = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.immediate_data = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.initial_r2t = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.data_seq_inorder = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.data_pdu_inorder = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.erl = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.max_receive_data_len = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.first_burst_len = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.max_outstanding_r2t = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.max_burst_len = 0
Oct 20 16:40:20 user nova-compute[74131]: iface.chap_auth = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.bidi_chap = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.strict_login_compliance = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.discovery_auth = <empty>
Oct 20 16:40:20 user nova-compute[74131]: iface.discovery_logout = <empty>
Oct 20 16:40:20 user nova-compute[74131]: node.discovery_address = <empty>
Oct 20 16:40:20 user nova-compute[74131]: node.discovery_port = 0
Oct 20 16:40:20 user nova-compute[74131]: node.discovery_type = static
Oct 20 16:40:20 user nova-compute[74131]: node.session.initial_cmdsn = 0
Oct 20 16:40:20 user nova-compute[74131]: node.session.initial_login_retry_max = 8
Oct 20 16:40:20 user nova-compute[74131]: node.session.xmit_thread_priority = -20
Oct 20 16:40:20 user nova-compute[74131]: node.session.cmds_max = 128
Oct 20 16:40:20 user nova-compute[74131]: node.session.queue_depth = 32
Oct 20 16:40:20 user nova-compute[74131]: node.session.nr_sessions = 1
Oct 20 16:40:20 user nova-compute[74131]: node.session.auth.authmethod = CHAP
Oct 20 16:40:20 user nova-compute[74131]: node.session.auth.username = OfcMoVWK
Oct 20 16:40:20 user nova-compute[74131]: node.session.auth.password = ***
Oct 20 16:40:20 user nova-compute[74131]: node.session.auth.username_in = <empty>
Oct 20 16:40:20 user nova-compute[74131]: node.session.auth.password_in = <empty>
Oct 20 16:40:20 user nova-compute[74131]: node.session.auth.chap_algs = MD5
Oct 20 16:40:20 user nova-compute[74131]: node.session.timeo.replacement_timeout = 120
Oct 20 16:40:20 user nova-compute[74131]: node.session.err_timeo.abort_timeout = 15
Oct 20 16:40:20 user nova-compute[74131]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 16:40:20 user nova-compute[74131]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 16:40:20 user nova-compute[74131]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.FastAbort = Yes
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.InitialR2T = No
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.ImmediateData = Yes
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.MaxConnections = 1
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 16:40:20 user nova-compute[74131]: node.session.iscsi.ERL = 0
Oct 20 16:40:20 user nova-compute[74131]: node.session.scan = manual
Oct 20 16:40:20 user nova-compute[74131]: node.session.reopen_max = 0
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].address = 172.16.0.220
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].port = 3260
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].startup = manual
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].tcp.window_size = 524288
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].tcp.type_of_service = 0
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].timeo.logout_timeout = 15
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].timeo.login_timeout = 15
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].timeo.auth_timeout = 45
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].iscsi.DataDigest = None
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].iscsi.IFMarker = No
Oct 20 16:40:20 user nova-compute[74131]: node.conn[0].iscsi.OFMarker = No
Oct 20 16:40:20 user nova-compute[74131]: # END RECORD
Oct 20 16:40:20 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48c8177-68ee-4ce4-9488-3ae85fdccb8d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50f8619-5945-4def-b6e4-938a4e4de2ef]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfcMoVWK {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfcMoVWK" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42f8e72-a3f3-4371-b7ca-6db7aafe794e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfcMoVWK'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad67d6-b140-4181-b34b-7d507add6247]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[03df94ed-b6fb-47cf-90fd-f5d554b2e812]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:40:20 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.187s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] HCTL ('36', '0', '0', 0) found on session 39 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d53ad7-beb7-44d5-9bb1-d32d28a8378c]: (4, ('0 0 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Searching for a device in session 39 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfcMoVWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.219s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== connect_volume: return (221ms) {'type': 'block', 'scsi_wwn': '26239636262386363', 'path': '/dev/sde'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239636262386363', 'path': '/dev/sde'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1418458451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1418458451',id=38,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:39:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-9kmg8d6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:39:08Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=e20dc23f-56e8-4800-89a0-b93db4520e1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "vif_mac": "fa:16:3e:f8:3a:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "vif_mac": "fa:16:3e:f8:3a:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.instance [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'pci_devices' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.objects.base [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Object Instance<e20dc23f-56e8-4800-89a0-b93db4520e1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:40:20 user nova-compute[74131]:   <uuid>e20dc23f-56e8-4800-89a0-b93db4520e1d</uuid>
Oct 20 16:40:20 user nova-compute[74131]:   <name>instance-00000026</name>
Oct 20 16:40:20 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:40:20 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:40:20 user nova-compute[74131]:   <metadata>
Oct 20 16:40:20 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:40:20 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:40:20 user nova-compute[74131]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1418458451</nova:name>
Oct 20 16:40:20 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:40:20</nova:creationTime>
Oct 20 16:40:20 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:40:20 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:40:20 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:40:20 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:40:20 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:40:20 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:40:20 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:40:20 user nova-compute[74131]:       <nova:owner>
Oct 20 16:40:20 user nova-compute[74131]:         <nova:user uuid="a82534b86e314f00896042e2e684a623">tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member</nova:user>
Oct 20 16:40:20 user nova-compute[74131]:         <nova:project uuid="097a2eccca244cbfa897e6a573a3113d">tempest-ServerBootFromVolumeStableRescueTest-131352591</nova:project>
Oct 20 16:40:20 user nova-compute[74131]:       </nova:owner>
Oct 20 16:40:20 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:40:20 user nova-compute[74131]:       <nova:ports>
Oct 20 16:40:20 user nova-compute[74131]:         <nova:port uuid="16d519d4-421e-4301-8d21-6b7a16eafa47">
Oct 20 16:40:20 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 16:40:20 user nova-compute[74131]:         </nova:port>
Oct 20 16:40:20 user nova-compute[74131]:       </nova:ports>
Oct 20 16:40:20 user nova-compute[74131]:     </nova:instance>
Oct 20 16:40:20 user nova-compute[74131]:   </metadata>
Oct 20 16:40:20 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:40:20 user nova-compute[74131]:     <system>
Oct 20 16:40:20 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:40:20 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:40:20 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:40:20 user nova-compute[74131]:       <entry name="serial">e20dc23f-56e8-4800-89a0-b93db4520e1d</entry>
Oct 20 16:40:20 user nova-compute[74131]:       <entry name="uuid">e20dc23f-56e8-4800-89a0-b93db4520e1d</entry>
Oct 20 16:40:20 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:40:20 user nova-compute[74131]:     </system>
Oct 20 16:40:20 user nova-compute[74131]:   </sysinfo>
Oct 20 16:40:20 user nova-compute[74131]:   <os>
Oct 20 16:40:20 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:40:20 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:40:20 user nova-compute[74131]:   </os>
Oct 20 16:40:20 user nova-compute[74131]:   <features>
Oct 20 16:40:20 user nova-compute[74131]:     <acpi/>
Oct 20 16:40:20 user nova-compute[74131]:     <apic/>
Oct 20 16:40:20 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:40:20 user nova-compute[74131]:   </features>
Oct 20 16:40:20 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:40:20 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:40:20 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:40:20 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:40:20 user nova-compute[74131]:   </clock>
Oct 20 16:40:20 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:40:20 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:40:20 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:40:20 user nova-compute[74131]:   </cpu>
Oct 20 16:40:20 user nova-compute[74131]:   <devices>
Oct 20 16:40:20 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:40:20 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:40:20 user nova-compute[74131]:       <source dev="/dev/sde"/>
Oct 20 16:40:20 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:40:20 user nova-compute[74131]:       <serial>5d619add-e12e-42ae-af37-13bc337e37f4</serial>
Oct 20 16:40:20 user nova-compute[74131]:     </disk>
Oct 20 16:40:20 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:40:20 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:40:20 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue"/>
Oct 20 16:40:20 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:40:20 user nova-compute[74131]:       <boot order="1"/>
Oct 20 16:40:20 user nova-compute[74131]:     </disk>
Oct 20 16:40:20 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:40:20 user nova-compute[74131]:       <mac address="fa:16:3e:f8:3a:66"/>
Oct 20 16:40:20 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:40:20 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:40:20 user nova-compute[74131]:       <target dev="tap16d519d4-42"/>
Oct 20 16:40:20 user nova-compute[74131]:     </interface>
Oct 20 16:40:20 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:40:20 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/console.log" append="off"/>
Oct 20 16:40:20 user nova-compute[74131]:     </serial>
Oct 20 16:40:20 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:40:20 user nova-compute[74131]:     <video>
Oct 20 16:40:20 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:40:20 user nova-compute[74131]:     </video>
Oct 20 16:40:20 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:40:20 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:40:20 user nova-compute[74131]:     </rng>
Oct 20 16:40:20 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:40:20 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:40:20 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:40:20 user nova-compute[74131]:     </memballoon>
Oct 20 16:40:20 user nova-compute[74131]:   </devices>
Oct 20 16:40:20 user nova-compute[74131]: </domain>
Oct 20 16:40:20 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:40:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance destroyed successfully.
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:40:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] No VIF found with MAC fa:16:3e:f8:3a:66, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:40:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-88fe9cde-8d9b-4c7e-bc7b-b77dcafb72e6 req-6f5cd543-0126-41c2-8e69-16afb8ca628b service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88fe9cde-8d9b-4c7e-bc7b-b77dcafb72e6 req-6f5cd543-0126-41c2-8e69-16afb8ca628b service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88fe9cde-8d9b-4c7e-bc7b-b77dcafb72e6 req-6f5cd543-0126-41c2-8e69-16afb8ca628b service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88fe9cde-8d9b-4c7e-bc7b-b77dcafb72e6 req-6f5cd543-0126-41c2-8e69-16afb8ca628b service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-88fe9cde-8d9b-4c7e-bc7b-b77dcafb72e6 req-6f5cd543-0126-41c2-8e69-16afb8ca628b service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:22 user nova-compute[74131]: WARNING nova.compute.manager [req-88fe9cde-8d9b-4c7e-bc7b-b77dcafb72e6 req-6f5cd543-0126-41c2-8e69-16afb8ca628b service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state active and task_state rescuing.
Oct 20 16:40:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:22 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:40:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9cff79f-6ad0-45c0-ba2d-5988bd932041 req-f0cb643a-e754-4086-af3f-7d3c6a1a43d6 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9cff79f-6ad0-45c0-ba2d-5988bd932041 req-f0cb643a-e754-4086-af3f-7d3c6a1a43d6 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9cff79f-6ad0-45c0-ba2d-5988bd932041 req-f0cb643a-e754-4086-af3f-7d3c6a1a43d6 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c9cff79f-6ad0-45c0-ba2d-5988bd932041 req-f0cb643a-e754-4086-af3f-7d3c6a1a43d6 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-c9cff79f-6ad0-45c0-ba2d-5988bd932041 req-f0cb643a-e754-4086-af3f-7d3c6a1a43d6 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:24 user nova-compute[74131]: WARNING nova.compute.manager [req-c9cff79f-6ad0-45c0-ba2d-5988bd932041 req-f0cb643a-e754-4086-af3f-7d3c6a1a43d6 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state active and task_state rescuing.
Oct 20 16:40:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:40:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af096082-82a8-4e50-b791-644e67378a97 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:40:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:26 user nova-compute[74131]: INFO nova.compute.manager [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Terminating instance
Oct 20 16:40:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-a99743a1-7d34-4a0c-ba6f-7169a138a410 req-99ceac3f-5d4d-45a8-ae2e-796cf42a9447 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received event network-vif-unplugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a99743a1-7d34-4a0c-ba6f-7169a138a410 req-99ceac3f-5d4d-45a8-ae2e-796cf42a9447 service nova] Acquiring lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a99743a1-7d34-4a0c-ba6f-7169a138a410 req-99ceac3f-5d4d-45a8-ae2e-796cf42a9447 service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a99743a1-7d34-4a0c-ba6f-7169a138a410 req-99ceac3f-5d4d-45a8-ae2e-796cf42a9447 service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-a99743a1-7d34-4a0c-ba6f-7169a138a410 req-99ceac3f-5d4d-45a8-ae2e-796cf42a9447 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] No waiting events found dispatching network-vif-unplugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-a99743a1-7d34-4a0c-ba6f-7169a138a410 req-99ceac3f-5d4d-45a8-ae2e-796cf42a9447 service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received event network-vif-unplugged-26dfd7d0-991d-4b43-9162-60ca4f326488 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Instance destroyed successfully.
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.objects.instance [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lazy-loading 'resources' on Instance uuid d2d6ed79-93cb-4689-8ea2-46daf90a65c0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-530622663',display_name='tempest-VolumesActionsTest-instance-530622663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-530622663',id=39,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22ae0ab6863f4f07a65fbe7bc98e1e24',ramdisk_id='',reservation_id='r-30ah2ua6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1417678142',owner_user_name='tempest-VolumesActionsTest-1417678142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:38:43Z,user_data=None,user_id='920bc059cf2644199effa540a62c07ea',uuid=d2d6ed79-93cb-4689-8ea2-46daf90a65c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converting VIF {"id": "26dfd7d0-991d-4b43-9162-60ca4f326488", "address": "fa:16:3e:5a:2f:74", "network": {"id": "214b2217-405e-49c3-b765-893f1f635b85", "bridge": "br-int", "label": "tempest-VolumesActionsTest-693295446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ae0ab6863f4f07a65fbe7bc98e1e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfd7d0-99", "ovs_interfaceid": "26dfd7d0-991d-4b43-9162-60ca4f326488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=26dfd7d0-991d-4b43-9162-60ca4f326488,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfd7d0-99') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG os_vif [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=26dfd7d0-991d-4b43-9162-60ca4f326488,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfd7d0-99') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dfd7d0-99, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6c9cb74-1ba7-443c-a3cb-8b6ec8253915) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:27 user nova-compute[74131]: INFO os_vif [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=26dfd7d0-991d-4b43-9162-60ca4f326488,network=Network(214b2217-405e-49c3-b765-893f1f635b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfd7d0-99')
Oct 20 16:40:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Deleting instance files /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0_del
Oct 20 16:40:27 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Deletion of /opt/stack/data/nova/instances/d2d6ed79-93cb-4689-8ea2-46daf90a65c0_del complete
Oct 20 16:40:27 user nova-compute[74131]: INFO nova.compute.manager [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 16:40:27 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:40:27 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:40:28 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Took 0.61 seconds to deallocate network for instance.
Oct 20 16:40:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:40:28 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-05f9cafa-2199-4121-9d63-d05406a8c823 req-9fedeed0-34f9-42cc-93f9-ec7935b17cef service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received event network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-05f9cafa-2199-4121-9d63-d05406a8c823 req-9fedeed0-34f9-42cc-93f9-ec7935b17cef service nova] Acquiring lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-05f9cafa-2199-4121-9d63-d05406a8c823 req-9fedeed0-34f9-42cc-93f9-ec7935b17cef service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-05f9cafa-2199-4121-9d63-d05406a8c823 req-9fedeed0-34f9-42cc-93f9-ec7935b17cef service nova] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-05f9cafa-2199-4121-9d63-d05406a8c823 req-9fedeed0-34f9-42cc-93f9-ec7935b17cef service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] No waiting events found dispatching network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:29 user nova-compute[74131]: WARNING nova.compute.manager [req-05f9cafa-2199-4121-9d63-d05406a8c823 req-9fedeed0-34f9-42cc-93f9-ec7935b17cef service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received unexpected event network-vif-plugged-26dfd7d0-991d-4b43-9162-60ca4f326488 for instance with vm_state deleted and task_state None.
Oct 20 16:40:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-05f9cafa-2199-4121-9d63-d05406a8c823 req-9fedeed0-34f9-42cc-93f9-ec7935b17cef service nova] [instance: d2d6ed79-93cb-4689-8ea2-46daf90a65c0] Received event network-vif-deleted-26dfd7d0-991d-4b43-9162-60ca4f326488 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:40:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.995s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:29 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Deleted allocations for instance d2d6ed79-93cb-4689-8ea2-46daf90a65c0
Oct 20 16:40:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57b90aec-b941-4ee6-8ed4-ae5db9901d62 tempest-VolumesActionsTest-1417678142 tempest-VolumesActionsTest-1417678142-project-member] Lock "d2d6ed79-93cb-4689-8ea2-46daf90a65c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.816s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:40:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:40:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:40:33 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updating instance_info_cache with network_info: [{"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-562d3ea2-1242-44ef-938c-7e2113d46496" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:40:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:40:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:40:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:40:37 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=24.875926971435547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:40:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Applying migration context for instance 1d3dfe2f-845f-48fa-832b-58335159fd2d as it has an incoming, in-progress migration 29dab3ae-144b-44d6-9d0d-774ca639f609. Migration status is finished {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Applying migration context for instance 8915ee60-7b51-465d-ba63-c933e26c8a68 as it has an incoming, in-progress migration d859f1ba-9352-45fd-97ec-642606b74188. Migration status is finished {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 16:40:38 user nova-compute[74131]: INFO nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating resource usage from migration 29dab3ae-144b-44d6-9d0d-774ca639f609
Oct 20 16:40:38 user nova-compute[74131]: INFO nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating resource usage from migration d859f1ba-9352-45fd-97ec-642606b74188
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e20dc23f-56e8-4800-89a0-b93db4520e1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Migration 29dab3ae-144b-44d6-9d0d-774ca639f609 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Migration d859f1ba-9352-45fd-97ec-642606b74188 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 8915ee60-7b51-465d-ba63-c933e26c8a68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:40:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:40:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-changed-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Refreshing instance network info cache due to event network-changed-d5d6f4b5-333b-4241-a097-232e842afb20. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:40:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] Acquiring lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:40:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] Acquired lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:40:41 user nova-compute[74131]: DEBUG nova.network.neutron [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Refreshing network info cache for port d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Updated VIF entry in instance network info cache for port d5d6f4b5-333b-4241-a097-232e842afb20. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Updating instance_info_cache with network_info: [{"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3aa70eed-73fe-4a88-ab97-4f80d5b4dab6 req-417cdf43-574d-4b8f-8224-3d53c7790b73 service nova] Releasing lock "refresh_cache-4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:42 user nova-compute[74131]: INFO nova.compute.manager [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Terminating instance
Oct 20 16:40:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-01a3fda9-385c-4c60-801b-a9ec26e25a6a req-7ec4a855-49f2-4295-9f24-e000ebfd054c service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-vif-unplugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-01a3fda9-385c-4c60-801b-a9ec26e25a6a req-7ec4a855-49f2-4295-9f24-e000ebfd054c service nova] Acquiring lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-01a3fda9-385c-4c60-801b-a9ec26e25a6a req-7ec4a855-49f2-4295-9f24-e000ebfd054c service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-01a3fda9-385c-4c60-801b-a9ec26e25a6a req-7ec4a855-49f2-4295-9f24-e000ebfd054c service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-01a3fda9-385c-4c60-801b-a9ec26e25a6a req-7ec4a855-49f2-4295-9f24-e000ebfd054c service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] No waiting events found dispatching network-vif-unplugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-01a3fda9-385c-4c60-801b-a9ec26e25a6a req-7ec4a855-49f2-4295-9f24-e000ebfd054c service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-vif-unplugged-d5d6f4b5-333b-4241-a097-232e842afb20 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:40:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Instance destroyed successfully.
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'resources' on Instance uuid 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-577548710',display_name='tempest-TestVolumeBootPattern-server-577548710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-577548710',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:39:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-zfhz5n8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:39:16Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "d5d6f4b5-333b-4241-a097-232e842afb20", "address": "fa:16:3e:1b:2b:b8", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d6f4b5-33", "ovs_interfaceid": "d5d6f4b5-333b-4241-a097-232e842afb20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2b:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5d6f4b5-333b-4241-a097-232e842afb20,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d6f4b5-33') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_vif [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2b:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5d6f4b5-333b-4241-a097-232e842afb20,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d6f4b5-33') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5d6f4b5-33, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f922b076-045b-4d6a-ae7b-d7a04ceab5fd) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:40:43 user nova-compute[74131]: INFO os_vif [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2b:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5d6f4b5-333b-4241-a097-232e842afb20,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d6f4b5-33')
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:40:43 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4146a1aa-3c28-4e24-a9fa-9243ce54fea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:40:43 user nova-compute[74131]: No targets found.
Oct 20 16:40:43 user nova-compute[74131]: iSNS:
Oct 20 16:40:43 user nova-compute[74131]: No targets found.
Oct 20 16:40:43 user nova-compute[74131]: STATIC:
Oct 20 16:40:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:40:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:40:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:40:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28
Oct 20 16:40:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:40:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:40:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:40:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:40:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:40:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:40:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:40:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:40:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf
Oct 20 16:40:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:40:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:40:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:40:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:40:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:40:43 user nova-compute[74131]: FIRMWARE:
Oct 20 16:40:43 user nova-compute[74131]: No targets found.
Oct 20 16:40:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:40:43 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:40:43 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d079dc2-4678-45cb-bb25-9d7bada10209]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f829d1c-f847-4799-8b0e-45abfaa08222]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:40:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c8714310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31'): ({'sdf'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Removing single pathed devices sdf {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f686d-8868-47cc-8a6d-edbeb20875eb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8573a3-3431-4f45-9e50-3e45f3f30650]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flushing IO for device /dev/sdf {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf0af27-1798-4ed9-b80f-d265d7ba2e4b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.064s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60b4abf-2251-47b7-8756-d29f13fdaf64]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] SCSI volumes sdf have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO89ce2588-0036ff14dd9debe1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_89ce2588', '/dev/disk/by-id/scsi-23030333666663134') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3631375a-f7d9-4989-aa33-be41d5b18f73]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0504e125-1001-41c4-b074-60144743d3fe]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec502119-b1e0-4981-8669-5058095c93f1]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]
Oct 20 16:40:43 user nova-compute[74131]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.
Oct 20 16:40:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9531656-071a-41c5-aafc-1ec84e5bb813]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== disconnect_volume: return (382ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:40:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Deleting instance files /opt/stack/data/nova/instances/4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6_del
Oct 20 16:40:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Deletion of /opt/stack/data/nova/instances/4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6_del complete
Oct 20 16:40:43 user nova-compute[74131]: INFO nova.compute.manager [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 20 16:40:43 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:40:43 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:40:44 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:40:44 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Took 0.64 seconds to deallocate network for instance.
Oct 20 16:40:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-17265741-81e5-4409-9840-af2b8cd8a8d4 req-a46dd109-f251-4892-8359-f01004a328bb service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-vif-deleted-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:44 user nova-compute[74131]: INFO nova.compute.manager [req-17265741-81e5-4409-9840-af2b8cd8a8d4 req-a46dd109-f251-4892-8359-f01004a328bb service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Neutron deleted interface d5d6f4b5-333b-4241-a097-232e842afb20; detaching it from the instance and deleting it from the info cache
Oct 20 16:40:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-17265741-81e5-4409-9840-af2b8cd8a8d4 req-a46dd109-f251-4892-8359-f01004a328bb service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:40:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-17265741-81e5-4409-9840-af2b8cd8a8d4 req-a46dd109-f251-4892-8359-f01004a328bb service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Detach interface failed, port_id=d5d6f4b5-333b-4241-a097-232e842afb20, reason: Instance 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:40:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-dff4e6ee-35ae-4bcf-9419-5a7e687c7659 req-cc2e6957-aa0d-4d5a-987f-b60b57a8bd04 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received event network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:40:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dff4e6ee-35ae-4bcf-9419-5a7e687c7659 req-cc2e6957-aa0d-4d5a-987f-b60b57a8bd04 service nova] Acquiring lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dff4e6ee-35ae-4bcf-9419-5a7e687c7659 req-cc2e6957-aa0d-4d5a-987f-b60b57a8bd04 service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dff4e6ee-35ae-4bcf-9419-5a7e687c7659 req-cc2e6957-aa0d-4d5a-987f-b60b57a8bd04 service nova] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-dff4e6ee-35ae-4bcf-9419-5a7e687c7659 req-cc2e6957-aa0d-4d5a-987f-b60b57a8bd04 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] No waiting events found dispatching network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:40:44 user nova-compute[74131]: WARNING nova.compute.manager [req-dff4e6ee-35ae-4bcf-9419-5a7e687c7659 req-cc2e6957-aa0d-4d5a-987f-b60b57a8bd04 service nova] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Received unexpected event network-vif-plugged-d5d6f4b5-333b-4241-a097-232e842afb20 for instance with vm_state active and task_state deleting.
Oct 20 16:40:45 user nova-compute[74131]: INFO nova.compute.manager [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6] Took 0.84 seconds to detach 1 volumes for instance.
Oct 20 16:40:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:40:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:40:45 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:40:45 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:40:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:45 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Deleted allocations for instance 4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6
Oct 20 16:40:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4990a0e2-cb91-4a7b-b895-9a95290ce5c6 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "4164a8fd-ff2e-4ec6-adc4-b1ddffef74a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.279s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:40:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:40:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Port f5e64e14-ac02-4600-ac9b-9fa85e263786 binding to destination host user is already ACTIVE {{(pid=74131) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Creating tmpfile /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/tmp_boo4i1x to verify with other compute node that the instance is on the same shared storage. {{(pid=74131) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 20 16:41:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-a6ae4b65-9b53-4084-9dd1-0c8b19361d6f req-59f8023e-482d-4e73-bc8c-67a4ea954693 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a6ae4b65-9b53-4084-9dd1-0c8b19361d6f req-59f8023e-482d-4e73-bc8c-67a4ea954693 service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a6ae4b65-9b53-4084-9dd1-0c8b19361d6f req-59f8023e-482d-4e73-bc8c-67a4ea954693 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a6ae4b65-9b53-4084-9dd1-0c8b19361d6f req-59f8023e-482d-4e73-bc8c-67a4ea954693 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-a6ae4b65-9b53-4084-9dd1-0c8b19361d6f req-59f8023e-482d-4e73-bc8c-67a4ea954693 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:41:18 user nova-compute[74131]: WARNING nova.compute.manager [req-a6ae4b65-9b53-4084-9dd1-0c8b19361d6f req-59f8023e-482d-4e73-bc8c-67a4ea954693 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state resized and task_state resize_reverting.
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance destroyed successfully.
Oct 20 16:41:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lazy-loading 'resources' on Instance uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_vif [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e64e14-ac, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfa456ab-459e-4c87-aff2-345b44426734) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:18 user nova-compute[74131]: INFO os_vif [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac')
Oct 20 16:41:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:41:18 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96f9b69-ad24-45b7-b3c2-2ae36ede2203]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:41:18 user nova-compute[74131]: No targets found.
Oct 20 16:41:18 user nova-compute[74131]: iSNS:
Oct 20 16:41:18 user nova-compute[74131]: No targets found.
Oct 20 16:41:18 user nova-compute[74131]: STATIC:
Oct 20 16:41:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:41:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28
Oct 20 16:41:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:41:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf
Oct 20 16:41:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:41:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:18 user nova-compute[74131]: FIRMWARE:
Oct 20 16:41:18 user nova-compute[74131]: No targets found.
Oct 20 16:41:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:41:18 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:41:18 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[529dd66d-d50b-42e3-918c-984b4456881c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[956bdb4d-a4d6-455a-9a06-cfa951a053d5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:41:18 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e00f7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28'): ({'sdd'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Removing single pathed devices sdd {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66e04d-b37b-4dc6-86ac-42f085ede6ac]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[417e7bab-3dbb-44ae-a318-5fafab54d619]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flushing IO for device /dev/sdd {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5815f3b-71ba-42b7-916d-5b84ed12a055]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5323dc-5bf4-421e-9ee7-aa184fa00ce0]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[de543824-b289-445e-9a30-b5186022fc32]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f8a3a-cdd5-4d9e-8a5f-4f2d61471341]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]
Oct 20 16:41:19 user nova-compute[74131]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.
Oct 20 16:41:19 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a39093-9430-436a-90c1-d66ea19cce9e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== disconnect_volume: return (340ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:41:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:41:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-d41d5613-9dc5-40fd-90c7-e9375e22aaef req-dd23aff0-0d76-49f2-b2a3-aa38f7be5bbd service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:41:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d41d5613-9dc5-40fd-90c7-e9375e22aaef req-dd23aff0-0d76-49f2-b2a3-aa38f7be5bbd service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d41d5613-9dc5-40fd-90c7-e9375e22aaef req-dd23aff0-0d76-49f2-b2a3-aa38f7be5bbd service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d41d5613-9dc5-40fd-90c7-e9375e22aaef req-dd23aff0-0d76-49f2-b2a3-aa38f7be5bbd service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-d41d5613-9dc5-40fd-90c7-e9375e22aaef req-dd23aff0-0d76-49f2-b2a3-aa38f7be5bbd service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:41:20 user nova-compute[74131]: WARNING nova.compute.manager [req-d41d5613-9dc5-40fd-90c7-e9375e22aaef req-dd23aff0-0d76-49f2-b2a3-aa38f7be5bbd service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state resized and task_state resize_reverting.
Oct 20 16:41:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lazy-loading 'migration_context' on Instance uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG nova.objects.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Object Instance<1d3dfe2f-845f-48fa-832b-58335159fd2d> lazy-loaded attributes: resources,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.438s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:23 user nova-compute[74131]: INFO nova.compute.manager [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Swapping old allocation on dict_keys(['bae45930-01a8-4277-ad36-8055d9898c12']) held by migration 29dab3ae-144b-44d6-9d0d-774ca639f609 for instance
Oct 20 16:41:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Overwriting current allocation {'allocations': {'bae45930-01a8-4277-ad36-8055d9898c12': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 49}}, 'project_id': '75a52cd8d5604e8bb772e88a6e524385', 'user_id': '43f5b83594714d9b88c1ba68c6dbf532', 'consumer_generation': 1} on consumer 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG os_brick.utils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[832394d5-c17f-40eb-bdcf-550a5feaa1ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd0dd0-4a1c-44e0-a22c-d744bbad623b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e83f86b-4de0-470e-8291-835ef933fb83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6724c5a-bd9b-4289-be99-815a2f6afa6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:41:24 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:41:24 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87e5d5-a677-44b8-9cc4-e40ec3098192]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:41:24 user nova-compute[74131]: DEBUG os_brick.utils [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:41:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Going to confirm migration 2 {{(pid=74131) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquired lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'info_cache' on Instance uuid 8915ee60-7b51-465d-ba63-c933e26c8a68 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [{"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Releasing lock "refresh_cache-8915ee60-7b51-465d-ba63-c933e26c8a68" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'migration_context' on Instance uuid 8915ee60-7b51-465d-ba63-c933e26c8a68 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG nova.objects.base [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Object Instance<8915ee60-7b51-465d-ba63-c933e26c8a68> lazy-loaded attributes: info_cache,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:41:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.336s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:27 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Deleted allocation for migration d859f1ba-9352-45fd-97ec-642606b74188
Oct 20 16:41:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c165de64-06ac-47e6-9158-a918741e792b tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.227s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:41:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "2ae75eb1-f460-4304-aebd-541775743e3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:41:34 user nova-compute[74131]: INFO nova.compute.claims [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Claim successful on node user
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.network.neutron [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:41:34 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.policy [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c0f3a5e9862491897ec87644c577ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08267e8d79941d3a555dc3a51c58985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:41:34 user nova-compute[74131]: INFO nova.virt.block_device [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Booting with volume fd468416-0b4e-4d5f-97a7-71806199ac31 at /dev/vda
Oct 20 16:41:34 user nova-compute[74131]: DEBUG os_brick.utils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[de24a910-3a1d-477d-aa16-7495e114493c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd23a561-443f-4ad4-85df-9bf2d6c41cb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[790a9799-2dd3-4059-b2bc-7ff435ef0af9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dcc8e2-87e0-45a9-b3dc-8aa0116b9f5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:41:34 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:41:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f9ac3c-fe21-4191-aef2-e949b630e59d]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG os_brick.utils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:41:34 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating existing volume attachment record: 0791ea7c-ce0d-4880-8e98-d551c7bca62b {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:41:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Successfully created port: fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:41:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:41:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:41:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:41:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Successfully updated port: fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquired lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-changed-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Refreshing instance network info cache due to event network-changed-fb6f6be9-2cc1-4412-b6fc-31320ad56f81. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] Acquiring lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:36 user nova-compute[74131]: INFO nova.compute.manager [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Detaching volume 843400db-b249-47fd-ac36-0396f0a933cf
Oct 20 16:41:36 user nova-compute[74131]: INFO nova.virt.block_device [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Attempting to driver detach volume 843400db-b249-47fd-ac36-0396f0a933cf from mountpoint /dev/vdb
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating instance_info_cache with network_info: [{"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Attempting to detach device vdb from instance f77f165e-a8f0-4352-b8d0-bb48cf325369 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:41:36 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:41:36 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:41:36 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:41:36 user nova-compute[74131]:   <serial>843400db-b249-47fd-ac36-0396f0a933cf</serial>
Oct 20 16:41:36 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 16:41:36 user nova-compute[74131]: </disk>
Oct 20 16:41:36 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:41:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully detached device vdb from instance f77f165e-a8f0-4352-b8d0-bb48cf325369 from the persistent domain config.
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f77f165e-a8f0-4352-b8d0-bb48cf325369 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:41:36 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:41:36 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:41:36 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:41:36 user nova-compute[74131]:   <serial>843400db-b249-47fd-ac36-0396f0a933cf</serial>
Oct 20 16:41:36 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 16:41:36 user nova-compute[74131]: </disk>
Oct 20 16:41:36 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating instance_info_cache with network_info: [{"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Releasing lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Instance network_info: |[{"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] Acquired lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Refreshing network info cache for port fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updated VIF entry in instance network info cache for port fb6f6be9-2cc1-4412-b6fc-31320ad56f81. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.network.neutron [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating instance_info_cache with network_info: [{"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-760f7f0d-8e19-43f1-a257-6b90c04c0e4b req-7a3bbe07-0a6a-4664-8819-82098fece5ec service nova] Releasing lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:41:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:41:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8037MB free_disk=24.871673583984375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e20dc23f-56e8-4800-89a0-b93db4520e1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 8915ee60-7b51-465d-ba63-c933e26c8a68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2ae75eb1-f460-4304-aebd-541775743e3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:41:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:41:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:41:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Creating image(s)
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Ensure instance console log exists: /opt/stack/data/nova/instances/2ae75eb1-f460-4304-aebd-541775743e3f/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Start _get_guest_xml network_info=[{"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0791ea7c-ce0d-4880-8e98-d551c7bca62b', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ae75eb1-f460-4304-aebd-541775743e3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd468416-0b4e-4d5f-97a7-71806199ac31', 'serial': 'fd468416-0b4e-4d5f-97a7-71806199ac31'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:41:53 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:41:53 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:41:53 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:41:53 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:41:53 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa4f659-8890-45ce-8c94-46a77a414b56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:41:53 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6e29d-6c8a-42b8-aad1-62d08143060f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31] added
Oct 20 16:41:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c94b11d-44f1-4b23-80be-5c5c69a0ea61]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d19abe6-54c2-4569-978e-637ba97fbe6b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZrqEhAp {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZrqEhAp" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d95eba5-5eb2-46b4-813c-1f5cf0a58a3f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DZrqEhAp'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc8498c-4924-4b81-ac99-4d47c862339e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b797e5-2606-4705-9922-65a1e635d77a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b1fe82-17e0-4ca8-9f69-fc59bdb0cfb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]
Oct 20 16:41:53 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.
Oct 20 16:41:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e117f93-9708-4b7f-84ba-c134be529614]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb923d3b-b972-45d0-ae3f-8f5cda81be52]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb3c19-c929-4c0b-a9f9-b1dda052eac7]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:41:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:41:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:41:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23030333666663134', 'path': '/dev/sdd'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:41:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333666663134', 'path': '/dev/sdd'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-746578784',display_name='tempest-TestVolumeBootPattern-server-746578784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-746578784',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-ra34kpcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:41:35Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=2ae75eb1-f460-4304-aebd-541775743e3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:c2,bridge_name='br-int',has_traffic_filtering=True,id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f6be9-2c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ae75eb1-f460-4304-aebd-541775743e3f {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:41:55 user nova-compute[74131]:   <uuid>2ae75eb1-f460-4304-aebd-541775743e3f</uuid>
Oct 20 16:41:55 user nova-compute[74131]:   <name>instance-00000029</name>
Oct 20 16:41:55 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:41:55 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:41:55 user nova-compute[74131]:   <metadata>
Oct 20 16:41:55 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:41:55 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:41:55 user nova-compute[74131]:       <nova:name>tempest-TestVolumeBootPattern-server-746578784</nova:name>
Oct 20 16:41:55 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:41:53</nova:creationTime>
Oct 20 16:41:55 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:41:55 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:41:55 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:41:55 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:41:55 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:41:55 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:41:55 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:41:55 user nova-compute[74131]:       <nova:owner>
Oct 20 16:41:55 user nova-compute[74131]:         <nova:user uuid="6c0f3a5e9862491897ec87644c577ebf">tempest-TestVolumeBootPattern-978997028-project-member</nova:user>
Oct 20 16:41:55 user nova-compute[74131]:         <nova:project uuid="a08267e8d79941d3a555dc3a51c58985">tempest-TestVolumeBootPattern-978997028</nova:project>
Oct 20 16:41:55 user nova-compute[74131]:       </nova:owner>
Oct 20 16:41:55 user nova-compute[74131]:       <nova:ports>
Oct 20 16:41:55 user nova-compute[74131]:         <nova:port uuid="fb6f6be9-2cc1-4412-b6fc-31320ad56f81">
Oct 20 16:41:55 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 16:41:55 user nova-compute[74131]:         </nova:port>
Oct 20 16:41:55 user nova-compute[74131]:       </nova:ports>
Oct 20 16:41:55 user nova-compute[74131]:     </nova:instance>
Oct 20 16:41:55 user nova-compute[74131]:   </metadata>
Oct 20 16:41:55 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:41:55 user nova-compute[74131]:     <system>
Oct 20 16:41:55 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:41:55 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:41:55 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:41:55 user nova-compute[74131]:       <entry name="serial">2ae75eb1-f460-4304-aebd-541775743e3f</entry>
Oct 20 16:41:55 user nova-compute[74131]:       <entry name="uuid">2ae75eb1-f460-4304-aebd-541775743e3f</entry>
Oct 20 16:41:55 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:41:55 user nova-compute[74131]:     </system>
Oct 20 16:41:55 user nova-compute[74131]:   </sysinfo>
Oct 20 16:41:55 user nova-compute[74131]:   <os>
Oct 20 16:41:55 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:41:55 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:41:55 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:41:55 user nova-compute[74131]:   </os>
Oct 20 16:41:55 user nova-compute[74131]:   <features>
Oct 20 16:41:55 user nova-compute[74131]:     <acpi/>
Oct 20 16:41:55 user nova-compute[74131]:     <apic/>
Oct 20 16:41:55 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:41:55 user nova-compute[74131]:   </features>
Oct 20 16:41:55 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:41:55 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:41:55 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:41:55 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:41:55 user nova-compute[74131]:   </clock>
Oct 20 16:41:55 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:41:55 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:41:55 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:41:55 user nova-compute[74131]:   </cpu>
Oct 20 16:41:55 user nova-compute[74131]:   <devices>
Oct 20 16:41:55 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:41:55 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:41:55 user nova-compute[74131]:       <source dev="/dev/sdd"/>
Oct 20 16:41:55 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:41:55 user nova-compute[74131]:       <serial>fd468416-0b4e-4d5f-97a7-71806199ac31</serial>
Oct 20 16:41:55 user nova-compute[74131]:     </disk>
Oct 20 16:41:55 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:41:55 user nova-compute[74131]:       <mac address="fa:16:3e:c4:8c:c2"/>
Oct 20 16:41:55 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:41:55 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:41:55 user nova-compute[74131]:       <target dev="tapfb6f6be9-2c"/>
Oct 20 16:41:55 user nova-compute[74131]:     </interface>
Oct 20 16:41:55 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:41:55 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/2ae75eb1-f460-4304-aebd-541775743e3f/console.log" append="off"/>
Oct 20 16:41:55 user nova-compute[74131]:     </serial>
Oct 20 16:41:55 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:41:55 user nova-compute[74131]:     <video>
Oct 20 16:41:55 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:41:55 user nova-compute[74131]:     </video>
Oct 20 16:41:55 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:41:55 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:41:55 user nova-compute[74131]:     </rng>
Oct 20 16:41:55 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:41:55 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:41:55 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:41:55 user nova-compute[74131]:     </memballoon>
Oct 20 16:41:55 user nova-compute[74131]:   </devices>
Oct 20 16:41:55 user nova-compute[74131]: </domain>
Oct 20 16:41:55 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-746578784',display_name='tempest-TestVolumeBootPattern-server-746578784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-746578784',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-ra34kpcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:41:35Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=2ae75eb1-f460-4304-aebd-541775743e3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:c2,bridge_name='br-int',has_traffic_filtering=True,id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f6be9-2c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_vif [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:c2,bridge_name='br-int',has_traffic_filtering=True,id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f6be9-2c') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64e74145-28a0-59ae-b742-0a3cf18244a0', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb6f6be9-2c, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb6f6be9-2c, col_values=(('qos', UUID('f2370868-6eec-4d02-a211-9208d5be90ae')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb6f6be9-2c, col_values=(('external_ids', {'iface-id': 'fb6f6be9-2cc1-4412-b6fc-31320ad56f81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:8c:c2', 'vm-uuid': '2ae75eb1-f460-4304-aebd-541775743e3f'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:55 user nova-compute[74131]: INFO os_vif [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:c2,bridge_name='br-int',has_traffic_filtering=True,id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f6be9-2c')
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No VIF found with MAC fa:16:3e:c4:8c:c2, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Starting finish_revert_migration {{(pid=74131) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Start _get_guest_xml network_info=[{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ce5d2b76-4212-4cda-a9a2-17d5a4d18679', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1d3dfe2f-845f-48fa-832b-58335159fd2d', 'attached_at': '2023-10-20T16:41:56.000000', 'detached_at': '', 'volume_id': '5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'serial': '5da99352-e9ec-4fc3-996f-e3e5c300bf28'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:41:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:41:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:41:55 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:41:55 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:41:55 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[96360336-c17d-4bbf-9e54-dafcf0b7d336]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:41:55 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22b491-9a1b-4da2-8e50-a9939563fe60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28] added
Oct 20 16:41:55 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:55 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[385b6517-1aa0-4e73-ba14-f24dad12924c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4813ad93-acd4-417e-ab93-264265f6aa71]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rClImKHT {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rClImKHT" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afc4d3b-42f6-4f03-bc5c-267138713476]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rClImKHT'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5053a1-6b1b-46e7-aa0e-6f99bbdd9917]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0328f6-5cc4-4fa7-aa25-123ea9f8817d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)
Oct 20 16:41:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)
Oct 20 16:41:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6797a-4d38-427a-b743-fc715219911a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]
Oct 20 16:41:56 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.
Oct 20 16:41:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84a1a1-9f42-47f5-8216-d078f314bb05]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9c68d2-a1a7-4cc6-bbef-43da5dbd9f0c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)
Oct 20 16:41:56 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:41:56 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] HCTL ('39', '-', '-', 0) found on session 47 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[254acc42-dac9-4bc6-937f-ff6b98de17ff]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Searching for a device in session 47 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:56 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f77f165e-a8f0-4352-b8d0-bb48cf325369 is timed out.
Oct 20 16:41:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully detached device vdb from instance f77f165e-a8f0-4352-b8d0-bb48cf325369 from the live domain config.
Oct 20 16:41:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVXJFpHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:41:56 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:41:56 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-fa8e9f37-6377-4ed0-80eb-315b24ebc56b req-af90047b-8491-400d-9ff5-0f44314d615e service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fa8e9f37-6377-4ed0-80eb-315b24ebc56b req-af90047b-8491-400d-9ff5-0f44314d615e service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fa8e9f37-6377-4ed0-80eb-315b24ebc56b req-af90047b-8491-400d-9ff5-0f44314d615e service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fa8e9f37-6377-4ed0-80eb-315b24ebc56b req-af90047b-8491-400d-9ff5-0f44314d615e service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-fa8e9f37-6377-4ed0-80eb-315b24ebc56b req-af90047b-8491-400d-9ff5-0f44314d615e service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:41:56 user nova-compute[74131]: WARNING nova.compute.manager [req-fa8e9f37-6377-4ed0-80eb-315b24ebc56b req-af90047b-8491-400d-9ff5-0f44314d615e service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received unexpected event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with vm_state building and task_state spawning.
Oct 20 16:41:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23464333763663939', 'path': '/dev/sdh'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464333763663939', 'path': '/dev/sdh'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.500s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:41:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:41:57 user nova-compute[74131]:   <uuid>1d3dfe2f-845f-48fa-832b-58335159fd2d</uuid>
Oct 20 16:41:57 user nova-compute[74131]:   <name>instance-00000021</name>
Oct 20 16:41:57 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:41:57 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:41:57 user nova-compute[74131]:   <metadata>
Oct 20 16:41:57 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:41:57 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:41:57 user nova-compute[74131]:       <nova:name>tempest-ServerActionsTestOtherB-server-593432805</nova:name>
Oct 20 16:41:57 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:41:55</nova:creationTime>
Oct 20 16:41:57 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:41:57 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:41:57 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:41:57 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:41:57 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:41:57 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:41:57 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:41:57 user nova-compute[74131]:       <nova:owner>
Oct 20 16:41:57 user nova-compute[74131]:         <nova:user uuid="43f5b83594714d9b88c1ba68c6dbf532">tempest-ServerActionsTestOtherB-915456315-project-member</nova:user>
Oct 20 16:41:57 user nova-compute[74131]:         <nova:project uuid="75a52cd8d5604e8bb772e88a6e524385">tempest-ServerActionsTestOtherB-915456315</nova:project>
Oct 20 16:41:57 user nova-compute[74131]:       </nova:owner>
Oct 20 16:41:57 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:41:57 user nova-compute[74131]:       <nova:ports>
Oct 20 16:41:57 user nova-compute[74131]:         <nova:port uuid="f5e64e14-ac02-4600-ac9b-9fa85e263786">
Oct 20 16:41:57 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:41:57 user nova-compute[74131]:         </nova:port>
Oct 20 16:41:57 user nova-compute[74131]:       </nova:ports>
Oct 20 16:41:57 user nova-compute[74131]:     </nova:instance>
Oct 20 16:41:57 user nova-compute[74131]:   </metadata>
Oct 20 16:41:57 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:41:57 user nova-compute[74131]:     <system>
Oct 20 16:41:57 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:41:57 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:41:57 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:41:57 user nova-compute[74131]:       <entry name="serial">1d3dfe2f-845f-48fa-832b-58335159fd2d</entry>
Oct 20 16:41:57 user nova-compute[74131]:       <entry name="uuid">1d3dfe2f-845f-48fa-832b-58335159fd2d</entry>
Oct 20 16:41:57 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:41:57 user nova-compute[74131]:     </system>
Oct 20 16:41:57 user nova-compute[74131]:   </sysinfo>
Oct 20 16:41:57 user nova-compute[74131]:   <os>
Oct 20 16:41:57 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:41:57 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:41:57 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:41:57 user nova-compute[74131]:   </os>
Oct 20 16:41:57 user nova-compute[74131]:   <features>
Oct 20 16:41:57 user nova-compute[74131]:     <acpi/>
Oct 20 16:41:57 user nova-compute[74131]:     <apic/>
Oct 20 16:41:57 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:41:57 user nova-compute[74131]:   </features>
Oct 20 16:41:57 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:41:57 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:41:57 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:41:57 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:41:57 user nova-compute[74131]:   </clock>
Oct 20 16:41:57 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:41:57 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:41:57 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:41:57 user nova-compute[74131]:   </cpu>
Oct 20 16:41:57 user nova-compute[74131]:   <devices>
Oct 20 16:41:57 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:41:57 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:41:57 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk"/>
Oct 20 16:41:57 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:41:57 user nova-compute[74131]:     </disk>
Oct 20 16:41:57 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:41:57 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:41:57 user nova-compute[74131]:       <source dev="/dev/sdh"/>
Oct 20 16:41:57 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:41:57 user nova-compute[74131]:       <serial>5da99352-e9ec-4fc3-996f-e3e5c300bf28</serial>
Oct 20 16:41:57 user nova-compute[74131]:     </disk>
Oct 20 16:41:57 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:41:57 user nova-compute[74131]:       <mac address="fa:16:3e:45:39:ae"/>
Oct 20 16:41:57 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:41:57 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:41:57 user nova-compute[74131]:       <target dev="tapf5e64e14-ac"/>
Oct 20 16:41:57 user nova-compute[74131]:     </interface>
Oct 20 16:41:57 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:41:57 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/console.log" append="off"/>
Oct 20 16:41:57 user nova-compute[74131]:     </serial>
Oct 20 16:41:57 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:41:57 user nova-compute[74131]:     <video>
Oct 20 16:41:57 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:41:57 user nova-compute[74131]:     </video>
Oct 20 16:41:57 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:41:57 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:41:57 user nova-compute[74131]:     </rng>
Oct 20 16:41:57 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:41:57 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:41:57 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:41:57 user nova-compute[74131]:     </memballoon>
Oct 20 16:41:57 user nova-compute[74131]:   </devices>
Oct 20 16:41:57 user nova-compute[74131]: </domain>
Oct 20 16:41:57 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:41:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_vif [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47a6f30-0443-4f5b-89d3-56f40a1f7f41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:41:57 user nova-compute[74131]: No targets found.
Oct 20 16:41:57 user nova-compute[74131]: iSNS:
Oct 20 16:41:57 user nova-compute[74131]: No targets found.
Oct 20 16:41:57 user nova-compute[74131]: STATIC:
Oct 20 16:41:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:41:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28
Oct 20 16:41:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea
Oct 20 16:41:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:41:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:41:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf
Oct 20 16:41:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:41:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:41:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:41:57 user nova-compute[74131]: FIRMWARE:
Oct 20 16:41:57 user nova-compute[74131]: No targets found.
Oct 20 16:41:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:41:57 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:41:57 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1f92819-4927-51f3-887a-da0798ac76e5', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e64e14-ac, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e64e14-ac, col_values=(('qos', UUID('2250c69f-e185-4d83-9588-873d9973988c')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e64e14-ac, col_values=(('external_ids', {'iface-id': 'f5e64e14-ac02-4600-ac9b-9fa85e263786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:39:ae', 'vm-uuid': '1d3dfe2f-845f-48fa-832b-58335159fd2d'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:57 user nova-compute[74131]: INFO os_vif [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac')
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f64f40-288a-4b6b-96e4-fdce5929c94f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa967985-eed6-4046-8415-347a20f71a74]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4341d7f-126c-4ddf-81b4-e4b64b71fcea (non-flash)
Oct 20 16:41:57 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:41:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8650c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f4b120-7808-43e7-a156-2f21e79975da]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d72ba-7a07-4cac-9e40-eec0104c39a4]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e6d27b-fef3-49ea-a5be-a065391f5827]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9209f2fa-f5ee-411a-9ec1-b10ce3fb68db]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100fcda-27ba-4fee-8084-7b908e09c5bd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3246191c-db21-4d16-9627-e5a803e369d2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260]
Oct 20 16:41:57 user nova-compute[74131]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf, portal: 172.16.0.220,3260] successful.
Oct 20 16:41:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:843400db-b249-47fd-ac36-0396f0a933cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[27511d97-9ee5-421f-91f7-61612ef77dcd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== disconnect_volume: return (872ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:41:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:41:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Instance spawned successfully.
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:58 user nova-compute[74131]: INFO nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-05cb5931-0a58-4182-b974-ca6f2a660587 req-eda5cb99-ca78-44ca-83ac-ec0f916f2bf9 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-05cb5931-0a58-4182-b974-ca6f2a660587 req-eda5cb99-ca78-44ca-83ac-ec0f916f2bf9 service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-05cb5931-0a58-4182-b974-ca6f2a660587 req-eda5cb99-ca78-44ca-83ac-ec0f916f2bf9 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-05cb5931-0a58-4182-b974-ca6f2a660587 req-eda5cb99-ca78-44ca-83ac-ec0f916f2bf9 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-05cb5931-0a58-4182-b974-ca6f2a660587 req-eda5cb99-ca78-44ca-83ac-ec0f916f2bf9 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:41:58 user nova-compute[74131]: WARNING nova.compute.manager [req-05cb5931-0a58-4182-b974-ca6f2a660587 req-eda5cb99-ca78-44ca-83ac-ec0f916f2bf9 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received unexpected event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with vm_state building and task_state spawning.
Oct 20 16:41:58 user nova-compute[74131]: INFO nova.compute.manager [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Took 24.89 seconds to build instance.
Oct 20 16:41:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-e5f3e4cd-d3c3-472e-92f6-e5eb1d781b5d req-e0c7087b-1a6a-4ee3-8e75-b6ebacbdbbf0 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e5f3e4cd-d3c3-472e-92f6-e5eb1d781b5d req-e0c7087b-1a6a-4ee3-8e75-b6ebacbdbbf0 service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e5f3e4cd-d3c3-472e-92f6-e5eb1d781b5d req-e0c7087b-1a6a-4ee3-8e75-b6ebacbdbbf0 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e5f3e4cd-d3c3-472e-92f6-e5eb1d781b5d req-e0c7087b-1a6a-4ee3-8e75-b6ebacbdbbf0 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-e5f3e4cd-d3c3-472e-92f6-e5eb1d781b5d req-e0c7087b-1a6a-4ee3-8e75-b6ebacbdbbf0 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:41:59 user nova-compute[74131]: WARNING nova.compute.manager [req-e5f3e4cd-d3c3-472e-92f6-e5eb1d781b5d req-e0c7087b-1a6a-4ee3-8e75-b6ebacbdbbf0 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state resized and task_state resize_reverting.
Oct 20 16:41:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1ccebae0-bd0c-4a35-91cb-69e9380eef69 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "2ae75eb1-f460-4304-aebd-541775743e3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.025s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:41:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-833083c9-6cea-4fea-b493-b52ee2f953a6 req-ecb86167-af11-464e-94e3-d9b765feedf3 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-833083c9-6cea-4fea-b493-b52ee2f953a6 req-ecb86167-af11-464e-94e3-d9b765feedf3 service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-833083c9-6cea-4fea-b493-b52ee2f953a6 req-ecb86167-af11-464e-94e3-d9b765feedf3 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-833083c9-6cea-4fea-b493-b52ee2f953a6 req-ecb86167-af11-464e-94e3-d9b765feedf3 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-833083c9-6cea-4fea-b493-b52ee2f953a6 req-ecb86167-af11-464e-94e3-d9b765feedf3 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:01 user nova-compute[74131]: WARNING nova.compute.manager [req-833083c9-6cea-4fea-b493-b52ee2f953a6 req-ecb86167-af11-464e-94e3-d9b765feedf3 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state resized and task_state resize_reverting.
Oct 20 16:42:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:42:01 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance running successfully.
Oct 20 16:42:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] finish_revert_migration finished successfully. {{(pid=74131) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 20 16:42:01 user nova-compute[74131]: INFO nova.compute.manager [None req-6ed39332-9add-4eac-9808-9f6bead656b5 tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance to original state: 'active'
Oct 20 16:42:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:02 user nova-compute[74131]: DEBUG nova.objects.instance [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:42:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-51e4bf13-c291-4ae2-bd06-1a6bd739f032 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.571s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-87adfa79-741e-4936-91ac-0f0576e8edc2 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-87adfa79-741e-4936-91ac-0f0576e8edc2 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-87adfa79-741e-4936-91ac-0f0576e8edc2 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-87adfa79-741e-4936-91ac-0f0576e8edc2 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74131) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG nova.objects.instance [None req-87adfa79-741e-4936-91ac-0f0576e8edc2 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-25910512-8afa-4d89-aca4-4b18c0464c27 req-c0293e17-9cc9-47b1-b36d-47f5b595a695 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-25910512-8afa-4d89-aca4-4b18c0464c27 req-c0293e17-9cc9-47b1-b36d-47f5b595a695 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-25910512-8afa-4d89-aca4-4b18c0464c27 req-c0293e17-9cc9-47b1-b36d-47f5b595a695 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-25910512-8afa-4d89-aca4-4b18c0464c27 req-c0293e17-9cc9-47b1-b36d-47f5b595a695 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-25910512-8afa-4d89-aca4-4b18c0464c27 req-c0293e17-9cc9-47b1-b36d-47f5b595a695 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:03 user nova-compute[74131]: WARNING nova.compute.manager [req-25910512-8afa-4d89-aca4-4b18c0464c27 req-c0293e17-9cc9-47b1-b36d-47f5b595a695 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state active and task_state powering-off.
Oct 20 16:42:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance destroyed successfully.
Oct 20 16:42:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-87adfa79-741e-4936-91ac-0f0576e8edc2 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:42:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-87adfa79-741e-4936-91ac-0f0576e8edc2 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.941s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-ca860a81-c6d7-4c68-b511-b15449304e6f req-347e7101-12a1-432f-8899-a4fc9429ffb6 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ca860a81-c6d7-4c68-b511-b15449304e6f req-347e7101-12a1-432f-8899-a4fc9429ffb6 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ca860a81-c6d7-4c68-b511-b15449304e6f req-347e7101-12a1-432f-8899-a4fc9429ffb6 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ca860a81-c6d7-4c68-b511-b15449304e6f req-347e7101-12a1-432f-8899-a4fc9429ffb6 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-ca860a81-c6d7-4c68-b511-b15449304e6f req-347e7101-12a1-432f-8899-a4fc9429ffb6 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:06 user nova-compute[74131]: WARNING nova.compute.manager [req-ca860a81-c6d7-4c68-b511-b15449304e6f req-347e7101-12a1-432f-8899-a4fc9429ffb6 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state stopped and task_state None.
Oct 20 16:42:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:07 user nova-compute[74131]: INFO nova.compute.manager [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Unrescuing
Oct 20 16:42:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:42:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquired lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:42:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Updating instance_info_cache with network_info: [{"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Releasing lock "refresh_cache-e20dc23f-56e8-4800-89a0-b93db4520e1d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'flavor' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-044bb806-8da9-4f19-af88-695e1f8e5978 req-5b46d58e-c9cd-4f5f-a6dd-4047b3a6369a service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-044bb806-8da9-4f19-af88-695e1f8e5978 req-5b46d58e-c9cd-4f5f-a6dd-4047b3a6369a service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-044bb806-8da9-4f19-af88-695e1f8e5978 req-5b46d58e-c9cd-4f5f-a6dd-4047b3a6369a service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-044bb806-8da9-4f19-af88-695e1f8e5978 req-5b46d58e-c9cd-4f5f-a6dd-4047b3a6369a service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-044bb806-8da9-4f19-af88-695e1f8e5978 req-5b46d58e-c9cd-4f5f-a6dd-4047b3a6369a service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:08 user nova-compute[74131]: WARNING nova.compute.manager [req-044bb806-8da9-4f19-af88-695e1f8e5978 req-5b46d58e-c9cd-4f5f-a6dd-4047b3a6369a service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:42:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance destroyed successfully.
Oct 20 16:42:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-354a4acd-56b9-43af-a025-c6a0cfe7329f req-05473c3e-0c65-4bca-b7bc-715ef9e9b5d2 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-354a4acd-56b9-43af-a025-c6a0cfe7329f req-05473c3e-0c65-4bca-b7bc-715ef9e9b5d2 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-354a4acd-56b9-43af-a025-c6a0cfe7329f req-05473c3e-0c65-4bca-b7bc-715ef9e9b5d2 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-354a4acd-56b9-43af-a025-c6a0cfe7329f req-05473c3e-0c65-4bca-b7bc-715ef9e9b5d2 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-354a4acd-56b9-43af-a025-c6a0cfe7329f req-05473c3e-0c65-4bca-b7bc-715ef9e9b5d2 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:10 user nova-compute[74131]: WARNING nova.compute.manager [req-354a4acd-56b9-43af-a025-c6a0cfe7329f req-05473c3e-0c65-4bca-b7bc-715ef9e9b5d2 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:42:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:12 user nova-compute[74131]: WARNING nova.compute.manager [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:42:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:12 user nova-compute[74131]: DEBUG nova.compute.manager [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:12 user nova-compute[74131]: WARNING nova.compute.manager [req-cccd709e-04ed-447b-9454-abd70cc5d016 req-388f6738-6ded-4651-9652-fb6481330e82 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:42:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-49a5792b-cba0-4c12-ab9a-d722dee58e75 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:42:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:28 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:42:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:31 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:42:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:42:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:42:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [{"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-1d3dfe2f-845f-48fa-832b-58335159fd2d" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:42:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:37 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "d3cbe091-e7f6-475b-9865-99b1f5f14569" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:42:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=24.888797760009766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e20dc23f-56e8-4800-89a0-b93db4520e1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 8915ee60-7b51-465d-ba63-c933e26c8a68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2ae75eb1-f460-4304-aebd-541775743e3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d3cbe091-e7f6-475b-9865-99b1f5f14569 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.448s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:42:39 user nova-compute[74131]: INFO nova.compute.claims [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Claim successful on node user
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.network.neutron [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:42:40 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:42:40 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Creating image(s)
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "/opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "/opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG nova.policy [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a874c6fbeb3f4d4bba0dd2f321981e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42e0e06a5d84c068118c54496bda530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.169s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk 1073741824" returned: 0 in 0.093s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG nova.network.neutron [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Successfully created port: 8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Cannot resize image /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Ensure instance console log exists: /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG nova.network.neutron [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Successfully updated port: 8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "refresh_cache-d3cbe091-e7f6-475b-9865-99b1f5f14569" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquired lock "refresh_cache-d3cbe091-e7f6-475b-9865-99b1f5f14569" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:42:41 user nova-compute[74131]: DEBUG nova.network.neutron [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received event network-changed-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Refreshing instance network info cache due to event network-changed-8d9a9f54-2359-406c-9898-64a23f41bf42. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] Acquiring lock "refresh_cache-d3cbe091-e7f6-475b-9865-99b1f5f14569" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Updating instance_info_cache with network_info: [{"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Releasing lock "refresh_cache-d3cbe091-e7f6-475b-9865-99b1f5f14569" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Instance network_info: |[{"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] Acquired lock "refresh_cache-d3cbe091-e7f6-475b-9865-99b1f5f14569" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Refreshing network info cache for port 8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Start _get_guest_xml network_info=[{"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:42:42 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:42:42 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1379151669',display_name='tempest-VolumesNegativeTest-instance-1379151669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1379151669',id=42,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42e0e06a5d84c068118c54496bda530',ramdisk_id='',reservation_id='r-fztsz0ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1831001354',owner_user_name='tempest-VolumesNegativeTest-1831001354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:42:40Z,user_data=None,user_id='a874c6fbeb3f4d4bba0dd2f321981e8c',uuid=d3cbe091-e7f6-475b-9865-99b1f5f14569,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Converting VIF {"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:1f:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d9a9f54-2359-406c-9898-64a23f41bf42,network=Network(58e09570-8c10-4e6a-8c37-2a9fea8ce71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9a9f54-23') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.objects.instance [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lazy-loading 'pci_devices' on Instance uuid d3cbe091-e7f6-475b-9865-99b1f5f14569 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:42:42 user nova-compute[74131]:   <uuid>d3cbe091-e7f6-475b-9865-99b1f5f14569</uuid>
Oct 20 16:42:42 user nova-compute[74131]:   <name>instance-0000002a</name>
Oct 20 16:42:42 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:42:42 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:42:42 user nova-compute[74131]:   <metadata>
Oct 20 16:42:42 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:42:42 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:42:42 user nova-compute[74131]:       <nova:name>tempest-VolumesNegativeTest-instance-1379151669</nova:name>
Oct 20 16:42:42 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:42:42</nova:creationTime>
Oct 20 16:42:42 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:42:42 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:42:42 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:42:42 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:42:42 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:42:42 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:42:42 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:42:42 user nova-compute[74131]:       <nova:owner>
Oct 20 16:42:42 user nova-compute[74131]:         <nova:user uuid="a874c6fbeb3f4d4bba0dd2f321981e8c">tempest-VolumesNegativeTest-1831001354-project-member</nova:user>
Oct 20 16:42:42 user nova-compute[74131]:         <nova:project uuid="d42e0e06a5d84c068118c54496bda530">tempest-VolumesNegativeTest-1831001354</nova:project>
Oct 20 16:42:42 user nova-compute[74131]:       </nova:owner>
Oct 20 16:42:42 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:42:42 user nova-compute[74131]:       <nova:ports>
Oct 20 16:42:42 user nova-compute[74131]:         <nova:port uuid="8d9a9f54-2359-406c-9898-64a23f41bf42">
Oct 20 16:42:42 user nova-compute[74131]:           <nova:ip type="fixed" address="192.168.233.250" ipVersion="4"/>
Oct 20 16:42:42 user nova-compute[74131]:         </nova:port>
Oct 20 16:42:42 user nova-compute[74131]:       </nova:ports>
Oct 20 16:42:42 user nova-compute[74131]:     </nova:instance>
Oct 20 16:42:42 user nova-compute[74131]:   </metadata>
Oct 20 16:42:42 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:42:42 user nova-compute[74131]:     <system>
Oct 20 16:42:42 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:42:42 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:42:42 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:42:42 user nova-compute[74131]:       <entry name="serial">d3cbe091-e7f6-475b-9865-99b1f5f14569</entry>
Oct 20 16:42:42 user nova-compute[74131]:       <entry name="uuid">d3cbe091-e7f6-475b-9865-99b1f5f14569</entry>
Oct 20 16:42:42 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:42:42 user nova-compute[74131]:     </system>
Oct 20 16:42:42 user nova-compute[74131]:   </sysinfo>
Oct 20 16:42:42 user nova-compute[74131]:   <os>
Oct 20 16:42:42 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:42:42 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:42:42 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:42:42 user nova-compute[74131]:   </os>
Oct 20 16:42:42 user nova-compute[74131]:   <features>
Oct 20 16:42:42 user nova-compute[74131]:     <acpi/>
Oct 20 16:42:42 user nova-compute[74131]:     <apic/>
Oct 20 16:42:42 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:42:42 user nova-compute[74131]:   </features>
Oct 20 16:42:42 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:42:42 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:42:42 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:42:42 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:42:42 user nova-compute[74131]:   </clock>
Oct 20 16:42:42 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:42:42 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:42:42 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:42:42 user nova-compute[74131]:   </cpu>
Oct 20 16:42:42 user nova-compute[74131]:   <devices>
Oct 20 16:42:42 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:42:42 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:42:42 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk"/>
Oct 20 16:42:42 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:42:42 user nova-compute[74131]:     </disk>
Oct 20 16:42:42 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:42:42 user nova-compute[74131]:       <mac address="fa:16:3e:19:1f:e5"/>
Oct 20 16:42:42 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:42:42 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:42:42 user nova-compute[74131]:       <target dev="tap8d9a9f54-23"/>
Oct 20 16:42:42 user nova-compute[74131]:     </interface>
Oct 20 16:42:42 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:42:42 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/console.log" append="off"/>
Oct 20 16:42:42 user nova-compute[74131]:     </serial>
Oct 20 16:42:42 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:42:42 user nova-compute[74131]:     <video>
Oct 20 16:42:42 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:42:42 user nova-compute[74131]:     </video>
Oct 20 16:42:42 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:42:42 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:42:42 user nova-compute[74131]:     </rng>
Oct 20 16:42:42 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:42:42 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:42:42 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:42:42 user nova-compute[74131]:     </memballoon>
Oct 20 16:42:42 user nova-compute[74131]:   </devices>
Oct 20 16:42:42 user nova-compute[74131]: </domain>
Oct 20 16:42:42 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1379151669',display_name='tempest-VolumesNegativeTest-instance-1379151669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1379151669',id=42,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42e0e06a5d84c068118c54496bda530',ramdisk_id='',reservation_id='r-fztsz0ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1831001354',owner_user_name='tempest-VolumesNegativeTest-1831001354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:42:40Z,user_data=None,user_id='a874c6fbeb3f4d4bba0dd2f321981e8c',uuid=d3cbe091-e7f6-475b-9865-99b1f5f14569,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Converting VIF {"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:1f:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d9a9f54-2359-406c-9898-64a23f41bf42,network=Network(58e09570-8c10-4e6a-8c37-2a9fea8ce71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9a9f54-23') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG os_vif [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1f:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d9a9f54-2359-406c-9898-64a23f41bf42,network=Network(58e09570-8c10-4e6a-8c37-2a9fea8ce71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9a9f54-23') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcfffb9b-8b11-51fe-aeee-9544dc33e02c', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d9a9f54-23, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d9a9f54-23, col_values=(('qos', UUID('c10d4da5-a144-481c-aaff-31e7473c3fd2')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d9a9f54-23, col_values=(('external_ids', {'iface-id': '8d9a9f54-2359-406c-9898-64a23f41bf42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:1f:e5', 'vm-uuid': 'd3cbe091-e7f6-475b-9865-99b1f5f14569'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:42 user nova-compute[74131]: INFO os_vif [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1f:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d9a9f54-2359-406c-9898-64a23f41bf42,network=Network(58e09570-8c10-4e6a-8c37-2a9fea8ce71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9a9f54-23')
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] No VIF found with MAC fa:16:3e:19:1f:e5, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Updated VIF entry in instance network info cache for port 8d9a9f54-2359-406c-9898-64a23f41bf42. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG nova.network.neutron [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Updating instance_info_cache with network_info: [{"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:42:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-999d686d-3106-49a1-b62b-5e4858de8388 req-cdf9cd8c-a21a-4a6c-b04d-f3933e8855ac service nova] Releasing lock "refresh_cache-d3cbe091-e7f6-475b-9865-99b1f5f14569" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:42:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-d277c43b-31f7-4c4d-8abe-e9a347f6adad req-6d4c378f-39a5-411f-9706-dfbdf4c87b8e service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received event network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d277c43b-31f7-4c4d-8abe-e9a347f6adad req-6d4c378f-39a5-411f-9706-dfbdf4c87b8e service nova] Acquiring lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d277c43b-31f7-4c4d-8abe-e9a347f6adad req-6d4c378f-39a5-411f-9706-dfbdf4c87b8e service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d277c43b-31f7-4c4d-8abe-e9a347f6adad req-6d4c378f-39a5-411f-9706-dfbdf4c87b8e service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-d277c43b-31f7-4c4d-8abe-e9a347f6adad req-6d4c378f-39a5-411f-9706-dfbdf4c87b8e service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] No waiting events found dispatching network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:44 user nova-compute[74131]: WARNING nova.compute.manager [req-d277c43b-31f7-4c4d-8abe-e9a347f6adad req-6d4c378f-39a5-411f-9706-dfbdf4c87b8e service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received unexpected event network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 for instance with vm_state building and task_state spawning.
Oct 20 16:42:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-524ad614-85f4-4c51-93de-f7b46e3763d1 req-91e0f8af-0090-4847-ba47-2c904038808e service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received event network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-524ad614-85f4-4c51-93de-f7b46e3763d1 req-91e0f8af-0090-4847-ba47-2c904038808e service nova] Acquiring lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-524ad614-85f4-4c51-93de-f7b46e3763d1 req-91e0f8af-0090-4847-ba47-2c904038808e service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-524ad614-85f4-4c51-93de-f7b46e3763d1 req-91e0f8af-0090-4847-ba47-2c904038808e service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-524ad614-85f4-4c51-93de-f7b46e3763d1 req-91e0f8af-0090-4847-ba47-2c904038808e service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] No waiting events found dispatching network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:42:46 user nova-compute[74131]: WARNING nova.compute.manager [req-524ad614-85f4-4c51-93de-f7b46e3763d1 req-91e0f8af-0090-4847-ba47-2c904038808e service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received unexpected event network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 for instance with vm_state building and task_state spawning.
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:42:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Instance spawned successfully.
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:42:46 user nova-compute[74131]: INFO nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Took 5.97 seconds to spawn the instance on the hypervisor.
Oct 20 16:42:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:42:46 user nova-compute[74131]: INFO nova.compute.manager [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Took 7.22 seconds to build instance.
Oct 20 16:42:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-852447d7-6e7e-4416-b034-af762a683231 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.315s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:42:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:42:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:42:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:42:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:42:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:42:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:42:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:43:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:16 user nova-compute[74131]: INFO nova.compute.manager [None req-1e82598a-0825-42be-837c-b041e13c1067 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Get console output
Oct 20 16:43:17 user nova-compute[74131]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 16:43:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-changed-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:43:25 user nova-compute[74131]: DEBUG nova.compute.manager [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Refreshing instance network info cache due to event network-changed-fb6f6be9-2cc1-4412-b6fc-31320ad56f81. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:43:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] Acquiring lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:43:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] Acquired lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:43:25 user nova-compute[74131]: DEBUG nova.network.neutron [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Refreshing network info cache for port fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:43:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updated VIF entry in instance network info cache for port fb6f6be9-2cc1-4412-b6fc-31320ad56f81. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:43:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating instance_info_cache with network_info: [{"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:43:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c8897300-a158-46c0-a20a-7076444c51d3 req-25631af7-693e-4027-a703-8f0ca26e8206 service nova] Releasing lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:43:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:28 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:43:29 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:43:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:43:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:43:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:43:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Updating instance_info_cache with network_info: [{"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:43:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-dd50a97e-e624-4fb5-8818-20e357742c41" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:43:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:43:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:43:38 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:43:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "52e980d6-bf45-4bef-8e96-197911a2b57a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:41 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:43:41 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=7785MB free_disk=24.858013153076172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance e20dc23f-56e8-4800-89a0-b93db4520e1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 1d3dfe2f-845f-48fa-832b-58335159fd2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 8915ee60-7b51-465d-ba63-c933e26c8a68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2ae75eb1-f460-4304-aebd-541775743e3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d3cbe091-e7f6-475b-9865-99b1f5f14569 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 52e980d6-bf45-4bef-8e96-197911a2b57a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:43:41 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.331s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:43:42 user nova-compute[74131]: INFO nova.compute.claims [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Claim successful on node user
Oct 20 16:43:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:43:42 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG nova.policy [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c0f3a5e9862491897ec87644c577ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08267e8d79941d3a555dc3a51c58985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:43:42 user nova-compute[74131]: INFO nova.virt.block_device [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Booting with volume 89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 at /dev/vda
Oct 20 16:43:42 user nova-compute[74131]: DEBUG os_brick.utils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e9a663-24c4-4e92-901b-c2a7c57286e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:42 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5230a3-5ba6-47f8-8359-fbea1fae4e62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c602908d-7fd3-4498-99a0-0035b4c166fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece5cfb-28ac-476a-91ef-9400aa2f8a6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:43:43 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:43:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[20539695-33d4-4739-9990-0c0aeeb148fd]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG os_brick.utils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updating existing volume attachment record: ae3dc88e-fceb-42d2-a5da-675a6d0dc8bd {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:43:43 user nova-compute[74131]: DEBUG nova.network.neutron [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Successfully created port: 87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Successfully updated port: 87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquired lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-changed-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.compute.manager [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Refreshing instance network info cache due to event network-changed-87d1bab3-aa28-4828-ae22-d44ff072cd97. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] Acquiring lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updating instance_info_cache with network_info: [{"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Releasing lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Instance network_info: |[{"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] Acquired lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:43:44 user nova-compute[74131]: DEBUG nova.network.neutron [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Refreshing network info cache for port 87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:43:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updated VIF entry in instance network info cache for port 87d1bab3-aa28-4828-ae22-d44ff072cd97. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:43:45 user nova-compute[74131]: DEBUG nova.network.neutron [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updating instance_info_cache with network_info: [{"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:43:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de49b777-c267-4b59-a2a9-a3d26e452cc8 req-5485f4c1-e9cb-4d13-9fe4-c45f64c0bae8 service nova] Releasing lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:43:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:43:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:54 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:43:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquired lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:43:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:43:54 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'info_cache' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:54 user nova-compute[74131]: DEBUG nova.objects.base [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:43:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Releasing lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:43:55 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance destroyed successfully.
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'resources' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.base [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG os_vif [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap334ce2d7-c6, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83182ec0-d1ee-4959-9f9d-fed7276dd9a8) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:55 user nova-compute[74131]: INFO os_vif [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6')
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Start _get_guest_xml network_info=[{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'numa_topology' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.base [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:43:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:43:55 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'vcpu_model' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.base [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'pci_devices' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.base [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:43:55 user nova-compute[74131]:   <uuid>f77f165e-a8f0-4352-b8d0-bb48cf325369</uuid>
Oct 20 16:43:55 user nova-compute[74131]:   <name>instance-00000023</name>
Oct 20 16:43:55 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:43:55 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:43:55 user nova-compute[74131]:   <metadata>
Oct 20 16:43:55 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:43:55 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:43:55 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeTestJSON-server-57709410</nova:name>
Oct 20 16:43:55 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:43:55</nova:creationTime>
Oct 20 16:43:55 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:43:55 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:43:55 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:43:55 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:43:55 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:43:55 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:43:55 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:43:55 user nova-compute[74131]:       <nova:owner>
Oct 20 16:43:55 user nova-compute[74131]:         <nova:user uuid="fea2a757da8e46dda15f3e996a94940f">tempest-AttachVolumeTestJSON-791392427-project-member</nova:user>
Oct 20 16:43:55 user nova-compute[74131]:         <nova:project uuid="7795f458a4c844238e9dece3464d4b69">tempest-AttachVolumeTestJSON-791392427</nova:project>
Oct 20 16:43:55 user nova-compute[74131]:       </nova:owner>
Oct 20 16:43:55 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:43:55 user nova-compute[74131]:       <nova:ports>
Oct 20 16:43:55 user nova-compute[74131]:         <nova:port uuid="334ce2d7-c655-430b-8c98-25c37e643e6a">
Oct 20 16:43:55 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:43:55 user nova-compute[74131]:         </nova:port>
Oct 20 16:43:55 user nova-compute[74131]:       </nova:ports>
Oct 20 16:43:55 user nova-compute[74131]:     </nova:instance>
Oct 20 16:43:55 user nova-compute[74131]:   </metadata>
Oct 20 16:43:55 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:43:55 user nova-compute[74131]:     <system>
Oct 20 16:43:55 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:43:55 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:43:55 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:43:55 user nova-compute[74131]:       <entry name="serial">f77f165e-a8f0-4352-b8d0-bb48cf325369</entry>
Oct 20 16:43:55 user nova-compute[74131]:       <entry name="uuid">f77f165e-a8f0-4352-b8d0-bb48cf325369</entry>
Oct 20 16:43:55 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:43:55 user nova-compute[74131]:     </system>
Oct 20 16:43:55 user nova-compute[74131]:   </sysinfo>
Oct 20 16:43:55 user nova-compute[74131]:   <os>
Oct 20 16:43:55 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:43:55 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:43:55 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:43:55 user nova-compute[74131]:   </os>
Oct 20 16:43:55 user nova-compute[74131]:   <features>
Oct 20 16:43:55 user nova-compute[74131]:     <acpi/>
Oct 20 16:43:55 user nova-compute[74131]:     <apic/>
Oct 20 16:43:55 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:43:55 user nova-compute[74131]:   </features>
Oct 20 16:43:55 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:43:55 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:43:55 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:43:55 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:43:55 user nova-compute[74131]:   </clock>
Oct 20 16:43:55 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:43:55 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:43:55 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:43:55 user nova-compute[74131]:   </cpu>
Oct 20 16:43:55 user nova-compute[74131]:   <devices>
Oct 20 16:43:55 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:43:55 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:43:55 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk"/>
Oct 20 16:43:55 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:43:55 user nova-compute[74131]:     </disk>
Oct 20 16:43:55 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:43:55 user nova-compute[74131]:       <mac address="fa:16:3e:28:94:04"/>
Oct 20 16:43:55 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:43:55 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:43:55 user nova-compute[74131]:       <target dev="tap334ce2d7-c6"/>
Oct 20 16:43:55 user nova-compute[74131]:     </interface>
Oct 20 16:43:55 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:43:55 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/console.log" append="off"/>
Oct 20 16:43:55 user nova-compute[74131]:     </serial>
Oct 20 16:43:55 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:43:55 user nova-compute[74131]:     <video>
Oct 20 16:43:55 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:43:55 user nova-compute[74131]:     </video>
Oct 20 16:43:55 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:43:55 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:43:55 user nova-compute[74131]:     </rng>
Oct 20 16:43:55 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:43:55 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:43:55 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:43:55 user nova-compute[74131]:     </memballoon>
Oct 20 16:43:55 user nova-compute[74131]:   </devices>
Oct 20 16:43:55 user nova-compute[74131]: </domain>
Oct 20 16:43:55 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'trusted_certs' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.base [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.191s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Cannot resize image /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:43:55 user nova-compute[74131]: DEBUG nova.objects.instance [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'migration_context' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG nova.objects.base [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Object Instance<f77f165e-a8f0-4352-b8d0-bb48cf325369> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG os_vif [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f89ea0-f2fc-5622-bff6-65b8cb764fa9', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap334ce2d7-c6, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap334ce2d7-c6, col_values=(('qos', UUID('f177b4ff-1af8-44df-8d41-6ec9625d4aa6')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap334ce2d7-c6, col_values=(('external_ids', {'iface-id': '334ce2d7-c655-430b-8c98-25c37e643e6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:94:04', 'vm-uuid': 'f77f165e-a8f0-4352-b8d0-bb48cf325369'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:43:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:56 user nova-compute[74131]: INFO os_vif [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6')
Oct 20 16:43:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-8f734cfd-32bc-4268-ad8f-8dc7b468bd56 req-627e96d3-bf33-4ce2-b22e-0916b1144e16 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8f734cfd-32bc-4268-ad8f-8dc7b468bd56 req-627e96d3-bf33-4ce2-b22e-0916b1144e16 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8f734cfd-32bc-4268-ad8f-8dc7b468bd56 req-627e96d3-bf33-4ce2-b22e-0916b1144e16 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8f734cfd-32bc-4268-ad8f-8dc7b468bd56 req-627e96d3-bf33-4ce2-b22e-0916b1144e16 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG nova.compute.manager [req-8f734cfd-32bc-4268-ad8f-8dc7b468bd56 req-627e96d3-bf33-4ce2-b22e-0916b1144e16 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:43:57 user nova-compute[74131]: WARNING nova.compute.manager [req-8f734cfd-32bc-4268-ad8f-8dc7b468bd56 req-627e96d3-bf33-4ce2-b22e-0916b1144e16 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state stopped and task_state powering-on.
Oct 20 16:43:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:43:58 user nova-compute[74131]: INFO nova.compute.manager [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Terminating instance
Oct 20 16:43:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-6a3fd931-cfc5-4e00-b3fb-b29f1e26f32c req-c7cd8e8b-6464-4e41-b5dd-d6ce88b61ebc service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6a3fd931-cfc5-4e00-b3fb-b29f1e26f32c req-c7cd8e8b-6464-4e41-b5dd-d6ce88b61ebc service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6a3fd931-cfc5-4e00-b3fb-b29f1e26f32c req-c7cd8e8b-6464-4e41-b5dd-d6ce88b61ebc service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-6a3fd931-cfc5-4e00-b3fb-b29f1e26f32c req-c7cd8e8b-6464-4e41-b5dd-d6ce88b61ebc service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-6a3fd931-cfc5-4e00-b3fb-b29f1e26f32c req-c7cd8e8b-6464-4e41-b5dd-d6ce88b61ebc service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-6a3fd931-cfc5-4e00-b3fb-b29f1e26f32c req-c7cd8e8b-6464-4e41-b5dd-d6ce88b61ebc service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-unplugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:43:59 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Instance destroyed successfully.
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.objects.instance [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'resources' on Instance uuid e20dc23f-56e8-4800-89a0-b93db4520e1d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:43:59 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance rebooted successfully.
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-afbac704-e89f-4703-b023-eea8622f2ca1 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1418458451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1418458451',id=38,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-9kmg8d6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:42:15Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=e20dc23f-56e8-4800-89a0-b93db4520e1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "16d519d4-421e-4301-8d21-6b7a16eafa47", "address": "fa:16:3e:f8:3a:66", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d519d4-42", "ovs_interfaceid": "16d519d4-421e-4301-8d21-6b7a16eafa47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_vif [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16d519d4-42, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38c15091-aa9b-4439-b323-5c8206e77a54) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:43:59 user nova-compute[74131]: INFO os_vif [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=16d519d4-421e-4301-8d21-6b7a16eafa47,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d519d4-42')
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfcMoVWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:43:59 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2bccc7-1f76-428c-a78d-12dc4f17d46f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:43:59 user nova-compute[74131]: No targets found.
Oct 20 16:43:59 user nova-compute[74131]: iSNS:
Oct 20 16:43:59 user nova-compute[74131]: No targets found.
Oct 20 16:43:59 user nova-compute[74131]: STATIC:
Oct 20 16:43:59 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4
Oct 20 16:43:59 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:43:59 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:43:59 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28
Oct 20 16:43:59 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:43:59 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:43:59 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:43:59 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:43:59 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:43:59 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:43:59 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:43:59 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:43:59 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:43:59 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:43:59 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:43:59 user nova-compute[74131]: FIRMWARE:
Oct 20 16:43:59 user nova-compute[74131]: No targets found.
Oct 20 16:43:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:43:59 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:43:59 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-d6299fb9-428b-403b-ae0c-7b889776d958 req-566e7d5f-52ee-4d69-aeac-d6c4fa8944d6 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d6299fb9-428b-403b-ae0c-7b889776d958 req-566e7d5f-52ee-4d69-aeac-d6c4fa8944d6 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d6299fb9-428b-403b-ae0c-7b889776d958 req-566e7d5f-52ee-4d69-aeac-d6c4fa8944d6 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d6299fb9-428b-403b-ae0c-7b889776d958 req-566e7d5f-52ee-4d69-aeac-d6c4fa8944d6 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-d6299fb9-428b-403b-ae0c-7b889776d958 req-566e7d5f-52ee-4d69-aeac-d6c4fa8944d6 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:43:59 user nova-compute[74131]: WARNING nova.compute.manager [req-d6299fb9-428b-403b-ae0c-7b889776d958 req-566e7d5f-52ee-4d69-aeac-d6c4fa8944d6 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state active and task_state None.
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6936ccc3-bfb5-41ea-8667-f39d293bda66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[901eddc1-1fbb-4ed8-a78d-c0a93966dec5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:43:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4'): ({'sde'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Removing single pathed devices sde {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2af53-4733-451b-8740-5066fc6bf8a4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3ecab-d230-4e9c-866a-b85ff4b84b64]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flushing IO for device /dev/sde {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[74910b7c-9972-4d35-a2f6-04e313fc1226]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[234e6959-1ae0-435e-b09a-3909ef8e268e]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] SCSI volumes sde have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1cddb3f0', '/dev/disk/by-id/scsi-26239636262386363', '/dev/disk/by-id/scsi-1SCST_BIO1cddb3f0-b9cbb8cc1ba02a97') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f2dace-d2c9-4f94-aae1-43216b9e0643]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970ab26-e50e-402a-bc81-faf5aeea0d0f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4c582-0e16-4d9f-bd20-4caba4a851eb]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260]
Oct 20 16:43:59 user nova-compute[74131]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4, portal: 172.16.0.220,3260] successful.
Oct 20 16:43:59 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d619add-e12e-42ae-af37-13bc337e37f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9b58a9-5463-49a6-82bc-595b6952bb5a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== disconnect_volume: return (368ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:43:59 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:43:59 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Deleting instance files /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d_del
Oct 20 16:43:59 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Deletion of /opt/stack/data/nova/instances/e20dc23f-56e8-4800-89a0-b93db4520e1d_del complete
Oct 20 16:44:00 user nova-compute[74131]: INFO nova.compute.manager [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 20 16:44:00 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:44:00 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:44:00 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:44:00 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:00 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Took 0.43 seconds to deallocate network for instance.
Oct 20 16:44:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-88057c2f-4133-4e07-ac72-1f3328a60371 req-2d10a50a-b40b-4c75-8569-f731d1fcae4d service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88057c2f-4133-4e07-ac72-1f3328a60371 req-2d10a50a-b40b-4c75-8569-f731d1fcae4d service nova] Acquiring lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88057c2f-4133-4e07-ac72-1f3328a60371 req-2d10a50a-b40b-4c75-8569-f731d1fcae4d service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-88057c2f-4133-4e07-ac72-1f3328a60371 req-2d10a50a-b40b-4c75-8569-f731d1fcae4d service nova] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-88057c2f-4133-4e07-ac72-1f3328a60371 req-2d10a50a-b40b-4c75-8569-f731d1fcae4d service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] No waiting events found dispatching network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:01 user nova-compute[74131]: WARNING nova.compute.manager [req-88057c2f-4133-4e07-ac72-1f3328a60371 req-2d10a50a-b40b-4c75-8569-f731d1fcae4d service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received unexpected event network-vif-plugged-16d519d4-421e-4301-8d21-6b7a16eafa47 for instance with vm_state active and task_state deleting.
Oct 20 16:44:01 user nova-compute[74131]: INFO nova.compute.manager [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Took 0.83 seconds to detach 1 volumes for instance.
Oct 20 16:44:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG nova.compute.manager [req-62316fd4-8f4b-4299-873b-a1987b6cc930 req-5549d5a4-8ae4-40cd-bff1-f3dbe3692903 service nova] [instance: e20dc23f-56e8-4800-89a0-b93db4520e1d] Received event network-vif-deleted-16d519d4-421e-4301-8d21-6b7a16eafa47 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:44:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:01 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Deleted allocations for instance e20dc23f-56e8-4800-89a0-b93db4520e1d
Oct 20 16:44:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-29a9c21c-1c5f-420a-a6ae-3fb877bf6a44 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "e20dc23f-56e8-4800-89a0-b93db4520e1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.128s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:44:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Creating image(s)
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Did not create local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Ensure instance console log exists: /opt/stack/data/nova/instances/52e980d6-bf45-4bef-8e96-197911a2b57a/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Start _get_guest_xml network_info=[{"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ae3dc88e-fceb-42d2-a5da-675a6d0dc8bd', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSbXkUlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52e980d6-bf45-4bef-8e96-197911a2b57a', 'attached_at': '', 'detached_at': '', 'volume_id': '89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2', 'serial': '89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:44:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:44:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSbXkUlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:44:05 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:44:05 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:44:05 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef667acd-4aa3-4289-9eed-cef67251e1e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:44:05 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d5831f-dedc-4f8d-a959-d0d705ecc150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2] added
Oct 20 16:44:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2476a9-dd2c-4c47-b898-7a173dcec144]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed98f402-93e7-4e08-a8df-8f72a380f728]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSbXkUlu {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSbXkUlu" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd976f47-95a0-499f-b5d4-ce867fd71b49]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DSbXkUlu'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eeaefb-a4be-4708-955b-98a83d978597]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f5e8c-4712-4158-aeb0-267b00c2b039]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:05 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:05 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:05 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:44:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:05 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:05 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:05 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:44:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10557bd-8240-44c2-ae93-a70846b1c41a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260]
Oct 20 16:44:05 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260] successful.
Oct 20 16:44:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab3317-249a-4ade-bd15-9c3d9b4c4a4a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8d95d3-d679-4ae5-bacb-3b2139cafbda]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:44:06 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4b839-a157-4bf4-92f0-00e71afaa723]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:44:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSbXkUlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23866653037333161', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866653037333161', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-800600043',display_name='tempest-TestVolumeBootPattern-server-800600043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-800600043',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-5oph2ico',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:43:43Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=52e980d6-bf45-4bef-8e96-197911a2b57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:85,bridge_name='br-int',has_traffic_filtering=True,id=87d1bab3-aa28-4828-ae22-d44ff072cd97,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d1bab3-aa') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.objects.instance [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'pci_devices' on Instance uuid 52e980d6-bf45-4bef-8e96-197911a2b57a {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:44:07 user nova-compute[74131]:   <uuid>52e980d6-bf45-4bef-8e96-197911a2b57a</uuid>
Oct 20 16:44:07 user nova-compute[74131]:   <name>instance-0000002b</name>
Oct 20 16:44:07 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:44:07 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:44:07 user nova-compute[74131]:   <metadata>
Oct 20 16:44:07 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:44:07 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:44:07 user nova-compute[74131]:       <nova:name>tempest-TestVolumeBootPattern-server-800600043</nova:name>
Oct 20 16:44:07 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:44:05</nova:creationTime>
Oct 20 16:44:07 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:44:07 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:44:07 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:44:07 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:44:07 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:44:07 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:44:07 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:44:07 user nova-compute[74131]:       <nova:owner>
Oct 20 16:44:07 user nova-compute[74131]:         <nova:user uuid="6c0f3a5e9862491897ec87644c577ebf">tempest-TestVolumeBootPattern-978997028-project-member</nova:user>
Oct 20 16:44:07 user nova-compute[74131]:         <nova:project uuid="a08267e8d79941d3a555dc3a51c58985">tempest-TestVolumeBootPattern-978997028</nova:project>
Oct 20 16:44:07 user nova-compute[74131]:       </nova:owner>
Oct 20 16:44:07 user nova-compute[74131]:       <nova:ports>
Oct 20 16:44:07 user nova-compute[74131]:         <nova:port uuid="87d1bab3-aa28-4828-ae22-d44ff072cd97">
Oct 20 16:44:07 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 16:44:07 user nova-compute[74131]:         </nova:port>
Oct 20 16:44:07 user nova-compute[74131]:       </nova:ports>
Oct 20 16:44:07 user nova-compute[74131]:     </nova:instance>
Oct 20 16:44:07 user nova-compute[74131]:   </metadata>
Oct 20 16:44:07 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:44:07 user nova-compute[74131]:     <system>
Oct 20 16:44:07 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:44:07 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:44:07 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:44:07 user nova-compute[74131]:       <entry name="serial">52e980d6-bf45-4bef-8e96-197911a2b57a</entry>
Oct 20 16:44:07 user nova-compute[74131]:       <entry name="uuid">52e980d6-bf45-4bef-8e96-197911a2b57a</entry>
Oct 20 16:44:07 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:44:07 user nova-compute[74131]:     </system>
Oct 20 16:44:07 user nova-compute[74131]:   </sysinfo>
Oct 20 16:44:07 user nova-compute[74131]:   <os>
Oct 20 16:44:07 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:44:07 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:44:07 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:44:07 user nova-compute[74131]:   </os>
Oct 20 16:44:07 user nova-compute[74131]:   <features>
Oct 20 16:44:07 user nova-compute[74131]:     <acpi/>
Oct 20 16:44:07 user nova-compute[74131]:     <apic/>
Oct 20 16:44:07 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:44:07 user nova-compute[74131]:   </features>
Oct 20 16:44:07 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:44:07 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:44:07 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:44:07 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:44:07 user nova-compute[74131]:   </clock>
Oct 20 16:44:07 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:44:07 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:44:07 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:44:07 user nova-compute[74131]:   </cpu>
Oct 20 16:44:07 user nova-compute[74131]:   <devices>
Oct 20 16:44:07 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 16:44:07 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:44:07 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 16:44:07 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:44:07 user nova-compute[74131]:       <serial>89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2</serial>
Oct 20 16:44:07 user nova-compute[74131]:     </disk>
Oct 20 16:44:07 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:44:07 user nova-compute[74131]:       <mac address="fa:16:3e:45:3e:85"/>
Oct 20 16:44:07 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:44:07 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:44:07 user nova-compute[74131]:       <target dev="tap87d1bab3-aa"/>
Oct 20 16:44:07 user nova-compute[74131]:     </interface>
Oct 20 16:44:07 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:44:07 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/52e980d6-bf45-4bef-8e96-197911a2b57a/console.log" append="off"/>
Oct 20 16:44:07 user nova-compute[74131]:     </serial>
Oct 20 16:44:07 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:44:07 user nova-compute[74131]:     <video>
Oct 20 16:44:07 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:44:07 user nova-compute[74131]:     </video>
Oct 20 16:44:07 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:44:07 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:44:07 user nova-compute[74131]:     </rng>
Oct 20 16:44:07 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:44:07 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:44:07 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:44:07 user nova-compute[74131]:     </memballoon>
Oct 20 16:44:07 user nova-compute[74131]:   </devices>
Oct 20 16:44:07 user nova-compute[74131]: </domain>
Oct 20 16:44:07 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-800600043',display_name='tempest-TestVolumeBootPattern-server-800600043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-800600043',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-5oph2ico',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:43:43Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=52e980d6-bf45-4bef-8e96-197911a2b57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:85,bridge_name='br-int',has_traffic_filtering=True,id=87d1bab3-aa28-4828-ae22-d44ff072cd97,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d1bab3-aa') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG os_vif [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:85,bridge_name='br-int',has_traffic_filtering=True,id=87d1bab3-aa28-4828-ae22-d44ff072cd97,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d1bab3-aa') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f3219d9-3a10-5dd2-a263-8f1845acd0a4', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87d1bab3-aa, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87d1bab3-aa, col_values=(('qos', UUID('3a53b3e9-9942-4a4e-8cc0-0cd75929910f')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87d1bab3-aa, col_values=(('external_ids', {'iface-id': '87d1bab3-aa28-4828-ae22-d44ff072cd97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:3e:85', 'vm-uuid': '52e980d6-bf45-4bef-8e96-197911a2b57a'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:07 user nova-compute[74131]: INFO os_vif [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:85,bridge_name='br-int',has_traffic_filtering=True,id=87d1bab3-aa28-4828-ae22-d44ff072cd97,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d1bab3-aa')
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:44:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] No VIF found with MAC fa:16:3e:45:3e:85, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-d26da614-7afe-4adb-b1ba-0eb85963b61d req-7a10a582-279e-4a2f-b5e2-c3f7db552001 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d26da614-7afe-4adb-b1ba-0eb85963b61d req-7a10a582-279e-4a2f-b5e2-c3f7db552001 service nova] Acquiring lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d26da614-7afe-4adb-b1ba-0eb85963b61d req-7a10a582-279e-4a2f-b5e2-c3f7db552001 service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d26da614-7afe-4adb-b1ba-0eb85963b61d req-7a10a582-279e-4a2f-b5e2-c3f7db552001 service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-d26da614-7afe-4adb-b1ba-0eb85963b61d req-7a10a582-279e-4a2f-b5e2-c3f7db552001 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] No waiting events found dispatching network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:08 user nova-compute[74131]: WARNING nova.compute.manager [req-d26da614-7afe-4adb-b1ba-0eb85963b61d req-7a10a582-279e-4a2f-b5e2-c3f7db552001 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received unexpected event network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 for instance with vm_state building and task_state spawning.
Oct 20 16:44:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:08 user nova-compute[74131]: INFO nova.compute.manager [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Terminating instance
Oct 20 16:44:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-87f9315c-5fce-4ca6-a84c-518d82f400da req-7ecc55e5-e98f-46c5-82ef-ce2bbcaa7965 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87f9315c-5fce-4ca6-a84c-518d82f400da req-7ecc55e5-e98f-46c5-82ef-ce2bbcaa7965 service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87f9315c-5fce-4ca6-a84c-518d82f400da req-7ecc55e5-e98f-46c5-82ef-ce2bbcaa7965 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-87f9315c-5fce-4ca6-a84c-518d82f400da req-7ecc55e5-e98f-46c5-82ef-ce2bbcaa7965 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-87f9315c-5fce-4ca6-a84c-518d82f400da req-7ecc55e5-e98f-46c5-82ef-ce2bbcaa7965 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-87f9315c-5fce-4ca6-a84c-518d82f400da req-7ecc55e5-e98f-46c5-82ef-ce2bbcaa7965 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-unplugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:44:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Instance destroyed successfully.
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.objects.instance [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lazy-loading 'resources' on Instance uuid 1d3dfe2f-845f-48fa-832b-58335159fd2d {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-593432805',display_name='tempest-ServerActionsTestOtherB-server-593432805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-593432805',id=33,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKApvfDzElB0t/qEfXVE5sPVRjc1/tbEtbT30hGJKRI0mxw22hPrGYdMgNoZVKON2PI8VDt/Faxc7WNZ7jCcgpUUzD2fukmAy3M7Z1bzc/lfwGR3p0hEeaMig+vjGF2Q==',key_name='tempest-keypair-1878853713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:42:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75a52cd8d5604e8bb772e88a6e524385',ramdisk_id='',reservation_id='r-rvfxa0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-915456315',owner_user_name='tempest-ServerActionsTestOtherB-915456315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:42:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f5b83594714d9b88c1ba68c6dbf532',uuid=1d3dfe2f-845f-48fa-832b-58335159fd2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converting VIF {"id": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "address": "fa:16:3e:45:39:ae", "network": {"id": "275a16c5-2c81-4daf-928f-f82b5dc660c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1525528198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a52cd8d5604e8bb772e88a6e524385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e64e14-ac", "ovs_interfaceid": "f5e64e14-ac02-4600-ac9b-9fa85e263786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_vif [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e64e14-ac, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2250c69f-e185-4d83-9588-873d9973988c) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:09 user nova-compute[74131]: INFO os_vif [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:ae,bridge_name='br-int',has_traffic_filtering=True,id=f5e64e14-ac02-4600-ac9b-9fa85e263786,network=Network(275a16c5-2c81-4daf-928f-f82b5dc660c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e64e14-ac')
Oct 20 16:44:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rClImKHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:44:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[422416d8-40a2-4180-9312-6a1832f3088a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:44:09 user nova-compute[74131]: No targets found.
Oct 20 16:44:09 user nova-compute[74131]: iSNS:
Oct 20 16:44:09 user nova-compute[74131]: No targets found.
Oct 20 16:44:09 user nova-compute[74131]: STATIC:
Oct 20 16:44:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28
Oct 20 16:44:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:44:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:44:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2
Oct 20 16:44:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:09 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:44:09 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:09 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:09 user nova-compute[74131]: FIRMWARE:
Oct 20 16:44:09 user nova-compute[74131]: No targets found.
Oct 20 16:44:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:44:09 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:44:09 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[43302f2f-eba0-43ee-bcf6-0e5eacd9125f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9dcd2d-981a-4ee5-8cc5-a2c041ce9bab]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:44:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e00f5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28'): ({'sdh'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Removing single pathed devices sdh {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0282393d-eba3-4617-bb36-48740f358a70]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b47209-7d34-4836-88e5-8ad845be458c]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Flushing IO for device /dev/sdh {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f015e64-5527-4f99-b3e8-56d04b0651f5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f921a2d-cbc4-4289-b785-57eab9bfd822]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] SCSI volumes sdh have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2428b2ce-1b97-4737-99c0-9c13471a702f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c0806-8769-4fd4-8781-30703a3ad176]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260]
Oct 20 16:44:10 user nova-compute[74131]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28, portal: 172.16.0.220,3260] successful.
Oct 20 16:44:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da99352-e9ec-4fc3-996f-e3e5c300bf28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f954c8a-701b-43b0-83ef-a08fffccdf48]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] <== disconnect_volume: return (344ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:44:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Deleting instance files /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d_del
Oct 20 16:44:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Deletion of /opt/stack/data/nova/instances/1d3dfe2f-845f-48fa-832b-58335159fd2d_del complete
Oct 20 16:44:10 user nova-compute[74131]: INFO nova.compute.manager [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-13d03cec-b43f-497f-82d8-c56ae0d62867 req-a4bba22b-9ffc-45cc-8e68-36280cc2cafd service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13d03cec-b43f-497f-82d8-c56ae0d62867 req-a4bba22b-9ffc-45cc-8e68-36280cc2cafd service nova] Acquiring lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13d03cec-b43f-497f-82d8-c56ae0d62867 req-a4bba22b-9ffc-45cc-8e68-36280cc2cafd service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13d03cec-b43f-497f-82d8-c56ae0d62867 req-a4bba22b-9ffc-45cc-8e68-36280cc2cafd service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-13d03cec-b43f-497f-82d8-c56ae0d62867 req-a4bba22b-9ffc-45cc-8e68-36280cc2cafd service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] No waiting events found dispatching network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:10 user nova-compute[74131]: WARNING nova.compute.manager [req-13d03cec-b43f-497f-82d8-c56ae0d62867 req-a4bba22b-9ffc-45cc-8e68-36280cc2cafd service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received unexpected event network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 for instance with vm_state building and task_state spawning.
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:44:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Instance spawned successfully.
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:10 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Took 0.73 seconds to deallocate network for instance.
Oct 20 16:44:10 user nova-compute[74131]: INFO nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Took 5.24 seconds to spawn the instance on the hypervisor.
Oct 20 16:44:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:44:11 user nova-compute[74131]: INFO nova.compute.manager [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Took 29.09 seconds to build instance.
Oct 20 16:44:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3e19df0d-be3f-490f-8c20-5a7ef0f836a8 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.282s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-0f6464f7-ee2b-4f23-a12a-4362f1fa0995 req-8425cb8f-89fb-42ce-a7b9-a7be88f0f8a0 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0f6464f7-ee2b-4f23-a12a-4362f1fa0995 req-8425cb8f-89fb-42ce-a7b9-a7be88f0f8a0 service nova] Acquiring lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0f6464f7-ee2b-4f23-a12a-4362f1fa0995 req-8425cb8f-89fb-42ce-a7b9-a7be88f0f8a0 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0f6464f7-ee2b-4f23-a12a-4362f1fa0995 req-8425cb8f-89fb-42ce-a7b9-a7be88f0f8a0 service nova] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-0f6464f7-ee2b-4f23-a12a-4362f1fa0995 req-8425cb8f-89fb-42ce-a7b9-a7be88f0f8a0 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] No waiting events found dispatching network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:11 user nova-compute[74131]: WARNING nova.compute.manager [req-0f6464f7-ee2b-4f23-a12a-4362f1fa0995 req-8425cb8f-89fb-42ce-a7b9-a7be88f0f8a0 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received unexpected event network-vif-plugged-f5e64e14-ac02-4600-ac9b-9fa85e263786 for instance with vm_state active and task_state deleting.
Oct 20 16:44:11 user nova-compute[74131]: DEBUG nova.compute.manager [req-0f6464f7-ee2b-4f23-a12a-4362f1fa0995 req-8425cb8f-89fb-42ce-a7b9-a7be88f0f8a0 service nova] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Received event network-vif-deleted-f5e64e14-ac02-4600-ac9b-9fa85e263786 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:11 user nova-compute[74131]: INFO nova.compute.manager [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] [instance: 1d3dfe2f-845f-48fa-832b-58335159fd2d] Took 0.85 seconds to detach 1 volumes for instance.
Oct 20 16:44:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:12 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:44:12 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:44:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:12 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Deleted allocations for instance 1d3dfe2f-845f-48fa-832b-58335159fd2d
Oct 20 16:44:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-501f7ae5-9870-47bb-8d87-3f737347536b tempest-ServerActionsTestOtherB-915456315 tempest-ServerActionsTestOtherB-915456315-project-member] Lock "1d3dfe2f-845f-48fa-832b-58335159fd2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.437s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:17 user nova-compute[74131]: INFO nova.compute.manager [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Terminating instance
Oct 20 16:44:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-e572e6e4-c397-4b53-9a91-f5993472a060 req-dfbe0fff-2064-4a3a-af2b-899bf9200e0c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-unplugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e572e6e4-c397-4b53-9a91-f5993472a060 req-dfbe0fff-2064-4a3a-af2b-899bf9200e0c service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e572e6e4-c397-4b53-9a91-f5993472a060 req-dfbe0fff-2064-4a3a-af2b-899bf9200e0c service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e572e6e4-c397-4b53-9a91-f5993472a060 req-dfbe0fff-2064-4a3a-af2b-899bf9200e0c service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-e572e6e4-c397-4b53-9a91-f5993472a060 req-dfbe0fff-2064-4a3a-af2b-899bf9200e0c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-unplugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-e572e6e4-c397-4b53-9a91-f5993472a060 req-dfbe0fff-2064-4a3a-af2b-899bf9200e0c service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-unplugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Instance destroyed successfully.
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'resources' on Instance uuid 8915ee60-7b51-465d-ba63-c933e26c8a68 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-8210013',display_name='tempest-ServerActionsTestOtherA-server-8210013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-8210013',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:40:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8iuw0r7w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=8915ee60-7b51-465d-ba63-c933e26c8a68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "address": "fa:16:3e:31:21:e2", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef823c6f-ea", "ovs_interfaceid": "ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_vif [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef823c6f-ea, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26cbd460-2ec2-49de-9aa9-f2a52cc6606f) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:18 user nova-compute[74131]: INFO os_vif [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:e2,bridge_name='br-int',has_traffic_filtering=True,id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef823c6f-ea')
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqColfhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:44:18 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b724a0-76ab-49ee-a6fb-0cf4cbafbc8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:44:18 user nova-compute[74131]: No targets found.
Oct 20 16:44:18 user nova-compute[74131]: iSNS:
Oct 20 16:44:18 user nova-compute[74131]: No targets found.
Oct 20 16:44:18 user nova-compute[74131]: STATIC:
Oct 20 16:44:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:44:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2
Oct 20 16:44:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2
Oct 20 16:44:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:18 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:44:18 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:44:18 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:44:18 user nova-compute[74131]: FIRMWARE:
Oct 20 16:44:18 user nova-compute[74131]: No targets found.
Oct 20 16:44:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:44:18 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:44:18 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdae6db-9114-48bb-8666-17bb41dd4540]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[022720ae-8f6a-4364-a914-b5a3893f5dfa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:18 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:18 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:18 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:44:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:44:18 user nova-compute[74131]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 (non-flash)
Oct 20 16:44:18 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:44:18 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:44:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e015bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2'): ({'sdg'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Removing single pathed devices sdg {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[07357b68-2a07-4ee5-b968-02642478a9e2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8021d4-b7e0-4b02-84d4-6d25e8dd85f0]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Flushing IO for device /dev/sdg {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c90cb1-842e-4e35-9f0d-b8c376026595]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dd2833-9034-4b2b-a505-b87e3703aaf9]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] SCSI volumes sdg have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7048f380-982f67d183ef7bce', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7048f380', '/dev/disk/by-id/scsi-23938326636376431') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[267e2311-5911-42cd-8579-e46e9d395b70]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9126dff-928d-49f1-8440-84b14f1f0182]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cdd0d-d20c-46ba-a116-2a13a9bae54a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260]
Oct 20 16:44:18 user nova-compute[74131]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2, portal: 172.16.0.220,3260] successful.
Oct 20 16:44:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40281c46-e7a9-4cf0-af38-f885962d82c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce87d44-0dd6-414e-a0af-636c52e34257]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] <== disconnect_volume: return (340ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:44:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Deleting instance files /opt/stack/data/nova/instances/8915ee60-7b51-465d-ba63-c933e26c8a68_del
Oct 20 16:44:18 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Deletion of /opt/stack/data/nova/instances/8915ee60-7b51-465d-ba63-c933e26c8a68_del complete
Oct 20 16:44:18 user nova-compute[74131]: INFO nova.compute.manager [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 20 16:44:18 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:44:18 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:44:19 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-54e21a66-2780-4d88-ba33-7a1a208bd2ec req-4ef93c0c-5ebb-4971-a5f8-2855cc6ae132 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-deleted-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:19 user nova-compute[74131]: INFO nova.compute.manager [req-54e21a66-2780-4d88-ba33-7a1a208bd2ec req-4ef93c0c-5ebb-4971-a5f8-2855cc6ae132 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Neutron deleted interface ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce; detaching it from the instance and deleting it from the info cache
Oct 20 16:44:19 user nova-compute[74131]: DEBUG nova.network.neutron [req-54e21a66-2780-4d88-ba33-7a1a208bd2ec req-4ef93c0c-5ebb-4971-a5f8-2855cc6ae132 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:19 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Took 0.77 seconds to deallocate network for instance.
Oct 20 16:44:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-54e21a66-2780-4d88-ba33-7a1a208bd2ec req-4ef93c0c-5ebb-4971-a5f8-2855cc6ae132 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Detach interface failed, port_id=ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce, reason: Instance 8915ee60-7b51-465d-ba63-c933e26c8a68 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:44:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-56a14b19-992c-4f28-aa0b-1131c0968dd4 req-ced54785-536a-4e89-af18-a20eee7cf9b9 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-56a14b19-992c-4f28-aa0b-1131c0968dd4 req-ced54785-536a-4e89-af18-a20eee7cf9b9 service nova] Acquiring lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-56a14b19-992c-4f28-aa0b-1131c0968dd4 req-ced54785-536a-4e89-af18-a20eee7cf9b9 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-56a14b19-992c-4f28-aa0b-1131c0968dd4 req-ced54785-536a-4e89-af18-a20eee7cf9b9 service nova] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-56a14b19-992c-4f28-aa0b-1131c0968dd4 req-ced54785-536a-4e89-af18-a20eee7cf9b9 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] No waiting events found dispatching network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:19 user nova-compute[74131]: WARNING nova.compute.manager [req-56a14b19-992c-4f28-aa0b-1131c0968dd4 req-ced54785-536a-4e89-af18-a20eee7cf9b9 service nova] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Received unexpected event network-vif-plugged-ef823c6f-ea58-41f0-84ca-8d4cfc6b8fce for instance with vm_state active and task_state deleting.
Oct 20 16:44:20 user nova-compute[74131]: INFO nova.compute.manager [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Took 0.80 seconds to detach 1 volumes for instance.
Oct 20 16:44:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 8915ee60-7b51-465d-ba63-c933e26c8a68] Deleting volume: 40281c46-e7a9-4cf0-af38-f885962d82c2 {{(pid=74131) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 16:44:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:20 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:44:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:44:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:20 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Deleted allocations for instance 8915ee60-7b51-465d-ba63-c933e26c8a68
Oct 20 16:44:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-31d8be26-6b81-4d9b-b385-b65300ede04e tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "8915ee60-7b51-465d-ba63-c933e26c8a68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.443s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "d3cbe091-e7f6-475b-9865-99b1f5f14569" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:29 user nova-compute[74131]: INFO nova.compute.manager [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Terminating instance
Oct 20 16:44:29 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-b74e7879-a42f-4f78-93ca-54760f32f368 req-d679a46e-248c-44b8-b2ef-3793fe5fbee9 service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received event network-vif-unplugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b74e7879-a42f-4f78-93ca-54760f32f368 req-d679a46e-248c-44b8-b2ef-3793fe5fbee9 service nova] Acquiring lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b74e7879-a42f-4f78-93ca-54760f32f368 req-d679a46e-248c-44b8-b2ef-3793fe5fbee9 service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b74e7879-a42f-4f78-93ca-54760f32f368 req-d679a46e-248c-44b8-b2ef-3793fe5fbee9 service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-b74e7879-a42f-4f78-93ca-54760f32f368 req-d679a46e-248c-44b8-b2ef-3793fe5fbee9 service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] No waiting events found dispatching network-vif-unplugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-b74e7879-a42f-4f78-93ca-54760f32f368 req-d679a46e-248c-44b8-b2ef-3793fe5fbee9 service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received event network-vif-unplugged-8d9a9f54-2359-406c-9898-64a23f41bf42 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:44:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Instance destroyed successfully.
Oct 20 16:44:30 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lazy-loading 'resources' on Instance uuid d3cbe091-e7f6-475b-9865-99b1f5f14569 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1379151669',display_name='tempest-VolumesNegativeTest-instance-1379151669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1379151669',id=42,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:42:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d42e0e06a5d84c068118c54496bda530',ramdisk_id='',reservation_id='r-fztsz0ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1831001354',owner_user_name='tempest-VolumesNegativeTest-1831001354-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:42:47Z,user_data=None,user_id='a874c6fbeb3f4d4bba0dd2f321981e8c',uuid=d3cbe091-e7f6-475b-9865-99b1f5f14569,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Converting VIF {"id": "8d9a9f54-2359-406c-9898-64a23f41bf42", "address": "fa:16:3e:19:1f:e5", "network": {"id": "58e09570-8c10-4e6a-8c37-2a9fea8ce71f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5889652fa55d4800a9bba1c85a9dcf68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9a9f54-23", "ovs_interfaceid": "8d9a9f54-2359-406c-9898-64a23f41bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:1f:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d9a9f54-2359-406c-9898-64a23f41bf42,network=Network(58e09570-8c10-4e6a-8c37-2a9fea8ce71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9a9f54-23') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG os_vif [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1f:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d9a9f54-2359-406c-9898-64a23f41bf42,network=Network(58e09570-8c10-4e6a-8c37-2a9fea8ce71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9a9f54-23') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d9a9f54-23, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c10d4da5-a144-481c-aaff-31e7473c3fd2) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:30 user nova-compute[74131]: INFO os_vif [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1f:e5,bridge_name='br-int',has_traffic_filtering=True,id=8d9a9f54-2359-406c-9898-64a23f41bf42,network=Network(58e09570-8c10-4e6a-8c37-2a9fea8ce71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9a9f54-23')
Oct 20 16:44:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Deleting instance files /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569_del
Oct 20 16:44:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Deletion of /opt/stack/data/nova/instances/d3cbe091-e7f6-475b-9865-99b1f5f14569_del complete
Oct 20 16:44:30 user nova-compute[74131]: INFO nova.compute.manager [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 16:44:30 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:31 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Took 0.66 seconds to deallocate network for instance.
Oct 20 16:44:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-54c67029-b205-449d-a6e3-e1fc49215ead req-9caa81d3-44e4-46d5-92cf-cd03a3260d61 service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received event network-vif-deleted-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:31 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Deleted allocations for instance d3cbe091-e7f6-475b-9865-99b1f5f14569
Oct 20 16:44:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b355beed-7ec2-41b9-aed2-78bc979e0206 tempest-VolumesNegativeTest-1831001354 tempest-VolumesNegativeTest-1831001354-project-member] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-ad735642-1322-46c6-899f-f6e40a8eaea5 req-258a6ea2-6b57-43da-bc9e-74ef04ea9238 service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received event network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ad735642-1322-46c6-899f-f6e40a8eaea5 req-258a6ea2-6b57-43da-bc9e-74ef04ea9238 service nova] Acquiring lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ad735642-1322-46c6-899f-f6e40a8eaea5 req-258a6ea2-6b57-43da-bc9e-74ef04ea9238 service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ad735642-1322-46c6-899f-f6e40a8eaea5 req-258a6ea2-6b57-43da-bc9e-74ef04ea9238 service nova] Lock "d3cbe091-e7f6-475b-9865-99b1f5f14569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-ad735642-1322-46c6-899f-f6e40a8eaea5 req-258a6ea2-6b57-43da-bc9e-74ef04ea9238 service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] No waiting events found dispatching network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:31 user nova-compute[74131]: WARNING nova.compute.manager [req-ad735642-1322-46c6-899f-f6e40a8eaea5 req-258a6ea2-6b57-43da-bc9e-74ef04ea9238 service nova] [instance: d3cbe091-e7f6-475b-9865-99b1f5f14569] Received unexpected event network-vif-plugged-8d9a9f54-2359-406c-9898-64a23f41bf42 for instance with vm_state deleted and task_state None.
Oct 20 16:44:34 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:38 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:44:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:44:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:44:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:44:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [{"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-f77f165e-a8f0-4352-b8d0-bb48cf325369" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:44:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:44:40 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:44:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:44:42 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:44:42 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:44:42 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8029MB free_disk=24.89360809326172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:44:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance dd50a97e-e624-4fb5-8818-20e357742c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2ae75eb1-f460-4304-aebd-541775743e3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 52e980d6-bf45-4bef-8e96-197911a2b57a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:44:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "dd50a97e-e624-4fb5-8818-20e357742c41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:49 user nova-compute[74131]: INFO nova.compute.manager [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Terminating instance
Oct 20 16:44:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dd5b24b-c75c-413a-a56c-315473f22c1d req-712d3eeb-50ca-4e6c-8919-2075228f4ff0 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received event network-vif-unplugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dd5b24b-c75c-413a-a56c-315473f22c1d req-712d3eeb-50ca-4e6c-8919-2075228f4ff0 service nova] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dd5b24b-c75c-413a-a56c-315473f22c1d req-712d3eeb-50ca-4e6c-8919-2075228f4ff0 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7dd5b24b-c75c-413a-a56c-315473f22c1d req-712d3eeb-50ca-4e6c-8919-2075228f4ff0 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dd5b24b-c75c-413a-a56c-315473f22c1d req-712d3eeb-50ca-4e6c-8919-2075228f4ff0 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] No waiting events found dispatching network-vif-unplugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-7dd5b24b-c75c-413a-a56c-315473f22c1d req-712d3eeb-50ca-4e6c-8919-2075228f4ff0 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received event network-vif-unplugged-b33a9b4c-c491-4b77-a708-4811da846517 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Instance destroyed successfully.
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'resources' on Instance uuid dd50a97e-e624-4fb5-8818-20e357742c41 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1720470027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1720470027',id=34,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-oamyfnjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:37:23Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=dd50a97e-e624-4fb5-8818-20e357742c41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "b33a9b4c-c491-4b77-a708-4811da846517", "address": "fa:16:3e:cc:0b:44", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33a9b4c-c4", "ovs_interfaceid": "b33a9b4c-c491-4b77-a708-4811da846517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:0b:44,bridge_name='br-int',has_traffic_filtering=True,id=b33a9b4c-c491-4b77-a708-4811da846517,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33a9b4c-c4') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG os_vif [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:0b:44,bridge_name='br-int',has_traffic_filtering=True,id=b33a9b4c-c491-4b77-a708-4811da846517,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33a9b4c-c4') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb33a9b4c-c4, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca0c1cf6-266e-4099-bfa3-ff27e26edec4) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:44:50 user nova-compute[74131]: INFO os_vif [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:0b:44,bridge_name='br-int',has_traffic_filtering=True,id=b33a9b4c-c491-4b77-a708-4811da846517,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33a9b4c-c4')
Oct 20 16:44:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Deleting instance files /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41_del
Oct 20 16:44:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Deletion of /opt/stack/data/nova/instances/dd50a97e-e624-4fb5-8818-20e357742c41_del complete
Oct 20 16:44:50 user nova-compute[74131]: INFO nova.compute.manager [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 20 16:44:50 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:50 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Took 0.49 seconds to deallocate network for instance.
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-64747d88-e11b-482e-afa2-600c6c858e0c req-7fb44283-4933-4518-99e2-ac99568845f4 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received event network-vif-deleted-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:50 user nova-compute[74131]: INFO nova.compute.manager [req-64747d88-e11b-482e-afa2-600c6c858e0c req-7fb44283-4933-4518-99e2-ac99568845f4 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Neutron deleted interface b33a9b4c-c491-4b77-a708-4811da846517; detaching it from the instance and deleting it from the info cache
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.network.neutron [req-64747d88-e11b-482e-afa2-600c6c858e0c req-7fb44283-4933-4518-99e2-ac99568845f4 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-64747d88-e11b-482e-afa2-600c6c858e0c req-7fb44283-4933-4518-99e2-ac99568845f4 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Detach interface failed, port_id=b33a9b4c-c491-4b77-a708-4811da846517, reason: Instance dd50a97e-e624-4fb5-8818-20e357742c41 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:51 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Deleted allocations for instance dd50a97e-e624-4fb5-8818-20e357742c41
Oct 20 16:44:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c58f0854-32e0-4736-bcc8-55dd0d79f70b tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "dd50a97e-e624-4fb5-8818-20e357742c41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.682s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-f60cf98b-89fb-4dbe-8ac6-7a1227f5f158 req-22c23393-7f7f-4bbd-82d3-81665dd38784 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received event network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f60cf98b-89fb-4dbe-8ac6-7a1227f5f158 req-22c23393-7f7f-4bbd-82d3-81665dd38784 service nova] Acquiring lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f60cf98b-89fb-4dbe-8ac6-7a1227f5f158 req-22c23393-7f7f-4bbd-82d3-81665dd38784 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f60cf98b-89fb-4dbe-8ac6-7a1227f5f158 req-22c23393-7f7f-4bbd-82d3-81665dd38784 service nova] Lock "dd50a97e-e624-4fb5-8818-20e357742c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:44:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-f60cf98b-89fb-4dbe-8ac6-7a1227f5f158 req-22c23393-7f7f-4bbd-82d3-81665dd38784 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] No waiting events found dispatching network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:44:51 user nova-compute[74131]: WARNING nova.compute.manager [req-f60cf98b-89fb-4dbe-8ac6-7a1227f5f158 req-22c23393-7f7f-4bbd-82d3-81665dd38784 service nova] [instance: dd50a97e-e624-4fb5-8818-20e357742c41] Received unexpected event network-vif-plugged-b33a9b4c-c491-4b77-a708-4811da846517 for instance with vm_state deleted and task_state None.
Oct 20 16:44:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:18 user nova-compute[74131]: INFO nova.compute.manager [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Terminating instance
Oct 20 16:45:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-2d311b3b-0f76-422e-8287-9270d3a9cd64 req-6adcd207-8ccc-47f0-bb43-e2bdaf30d127 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-vif-unplugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d311b3b-0f76-422e-8287-9270d3a9cd64 req-6adcd207-8ccc-47f0-bb43-e2bdaf30d127 service nova] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d311b3b-0f76-422e-8287-9270d3a9cd64 req-6adcd207-8ccc-47f0-bb43-e2bdaf30d127 service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d311b3b-0f76-422e-8287-9270d3a9cd64 req-6adcd207-8ccc-47f0-bb43-e2bdaf30d127 service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-2d311b3b-0f76-422e-8287-9270d3a9cd64 req-6adcd207-8ccc-47f0-bb43-e2bdaf30d127 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] No waiting events found dispatching network-vif-unplugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.compute.manager [req-2d311b3b-0f76-422e-8287-9270d3a9cd64 req-6adcd207-8ccc-47f0-bb43-e2bdaf30d127 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-vif-unplugged-ed1b4ad7-52eb-432e-877f-4430254707c3 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:45:19 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Instance destroyed successfully.
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.objects.instance [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lazy-loading 'resources' on Instance uuid 46c22ead-b9e5-4f15-8a36-f62c56dd5977 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1576117610',display_name='tempest-ServerActionsTestOtherA-server-1576117610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1576117610',id=15,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAXnmDbK5ViTHwm3fHfn1l+aKMLwQJmvvWMYlbp8j8ZfW2KM/oFtjaM9uRvNXoTloJmak24lJDuudVzk9DsqHb4QWMyNJ5110Rnmo0Q3l68c5GZXLYgnm8UqP4SRVJVMg==',key_name='tempest-keypair-611363506',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:25:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69db8a4e064f445abd0a8555aaa18b88',ramdisk_id='',reservation_id='r-8wkd6e0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-844175334',owner_user_name='tempest-ServerActionsTestOtherA-844175334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:25:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f6bff83a2e24a289333823acf911ccd',uuid=46c22ead-b9e5-4f15-8a36-f62c56dd5977,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converting VIF {"id": "ed1b4ad7-52eb-432e-877f-4430254707c3", "address": "fa:16:3e:e8:06:e9", "network": {"id": "c749e142-f28b-461a-a28f-eb1f0894cfdc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-491104535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69db8a4e064f445abd0a8555aaa18b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped1b4ad7-52", "ovs_interfaceid": "ed1b4ad7-52eb-432e-877f-4430254707c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:06:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed1b4ad7-52eb-432e-877f-4430254707c3,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1b4ad7-52') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG os_vif [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:06:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed1b4ad7-52eb-432e-877f-4430254707c3,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1b4ad7-52') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped1b4ad7-52, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab564161-2dc1-4c60-83d4-d06375e71093) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:19 user nova-compute[74131]: INFO os_vif [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:06:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed1b4ad7-52eb-432e-877f-4430254707c3,network=Network(c749e142-f28b-461a-a28f-eb1f0894cfdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1b4ad7-52')
Oct 20 16:45:19 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Deleting instance files /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977_del
Oct 20 16:45:19 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Deletion of /opt/stack/data/nova/instances/46c22ead-b9e5-4f15-8a36-f62c56dd5977_del complete
Oct 20 16:45:19 user nova-compute[74131]: INFO nova.compute.manager [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Took 0.72 seconds to destroy the instance on the hypervisor.
Oct 20 16:45:19 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:45:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:20 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:20 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Took 1.27 seconds to deallocate network for instance.
Oct 20 16:45:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-5e3da963-27f9-4a1a-955e-2e11b8240ad7 req-3432403b-5f3c-45f3-9ab0-9c3d24af32ca service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-vif-deleted-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:20 user nova-compute[74131]: INFO nova.compute.manager [req-5e3da963-27f9-4a1a-955e-2e11b8240ad7 req-3432403b-5f3c-45f3-9ab0-9c3d24af32ca service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Neutron deleted interface ed1b4ad7-52eb-432e-877f-4430254707c3; detaching it from the instance and deleting it from the info cache
Oct 20 16:45:20 user nova-compute[74131]: DEBUG nova.network.neutron [req-5e3da963-27f9-4a1a-955e-2e11b8240ad7 req-3432403b-5f3c-45f3-9ab0-9c3d24af32ca service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-5e3da963-27f9-4a1a-955e-2e11b8240ad7 req-3432403b-5f3c-45f3-9ab0-9c3d24af32ca service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Detach interface failed, port_id=ed1b4ad7-52eb-432e-877f-4430254707c3, reason: Instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:21 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Deleted allocations for instance 46c22ead-b9e5-4f15-8a36-f62c56dd5977
Oct 20 16:45:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-4a00fa93-a334-493a-9d4e-d8f84f4d9c35 req-90150b14-2dbc-4e6b-86af-77b31f313598 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received event network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4a00fa93-a334-493a-9d4e-d8f84f4d9c35 req-90150b14-2dbc-4e6b-86af-77b31f313598 service nova] Acquiring lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4a00fa93-a334-493a-9d4e-d8f84f4d9c35 req-90150b14-2dbc-4e6b-86af-77b31f313598 service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4a00fa93-a334-493a-9d4e-d8f84f4d9c35 req-90150b14-2dbc-4e6b-86af-77b31f313598 service nova] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-4a00fa93-a334-493a-9d4e-d8f84f4d9c35 req-90150b14-2dbc-4e6b-86af-77b31f313598 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] No waiting events found dispatching network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:21 user nova-compute[74131]: WARNING nova.compute.manager [req-4a00fa93-a334-493a-9d4e-d8f84f4d9c35 req-90150b14-2dbc-4e6b-86af-77b31f313598 service nova] [instance: 46c22ead-b9e5-4f15-8a36-f62c56dd5977] Received unexpected event network-vif-plugged-ed1b4ad7-52eb-432e-877f-4430254707c3 for instance with vm_state deleted and task_state None.
Oct 20 16:45:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-f75669d1-e8a1-4eba-8a88-d3d01402edc4 tempest-ServerActionsTestOtherA-844175334 tempest-ServerActionsTestOtherA-844175334-project-member] Lock "46c22ead-b9e5-4f15-8a36-f62c56dd5977" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.558s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "72c13338-0ecf-4383-a9db-b316bda13601" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:45:24 user nova-compute[74131]: INFO nova.compute.claims [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Claim successful on node user
Oct 20 16:45:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.network.neutron [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:45:24 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:45:24 user nova-compute[74131]: DEBUG nova.policy [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bc5139a72784dc8b85c3a17b9ce722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368249a7186c4968a3b8d8fa5fbd8737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:45:25 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Creating image(s)
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.214s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:45:25 user nova-compute[74131]: INFO nova.compute.claims [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Claim successful on node user
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.213s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk 1073741824" returned: 0 in 0.095s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.network.neutron [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Successfully created port: b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.256s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:45:25 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Cannot resize image /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Ensure instance console log exists: /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:45:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.policy [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bc5139a72784dc8b85c3a17b9ce722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368249a7186c4968a3b8d8fa5fbd8737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:45:26 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Creating image(s)
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Successfully updated port: b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-changed-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Refreshing instance network info cache due to event network-changed-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk 1073741824" returned: 0 in 0.070s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:26 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Successfully created port: 8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.198s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance network_info: |[{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Refreshing network info cache for port b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Start _get_guest_xml network_info=[{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:45:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:45:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-903614781',display_name='tempest-ServerRescueNegativeTestJSON-server-903614781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-903614781',id=44,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-wvb9jdcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:45:25Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=72c13338-0ecf-4383-a9db-b316bda13601,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.objects.instance [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:45:27 user nova-compute[74131]:   <uuid>72c13338-0ecf-4383-a9db-b316bda13601</uuid>
Oct 20 16:45:27 user nova-compute[74131]:   <name>instance-0000002c</name>
Oct 20 16:45:27 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:45:27 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:45:27 user nova-compute[74131]:   <metadata>
Oct 20 16:45:27 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:45:27 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:45:27 user nova-compute[74131]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-903614781</nova:name>
Oct 20 16:45:27 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:45:27</nova:creationTime>
Oct 20 16:45:27 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:45:27 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:45:27 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:45:27 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:45:27 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:45:27 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:45:27 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:45:27 user nova-compute[74131]:       <nova:owner>
Oct 20 16:45:27 user nova-compute[74131]:         <nova:user uuid="5bc5139a72784dc8b85c3a17b9ce722d">tempest-ServerRescueNegativeTestJSON-1760443836-project-member</nova:user>
Oct 20 16:45:27 user nova-compute[74131]:         <nova:project uuid="368249a7186c4968a3b8d8fa5fbd8737">tempest-ServerRescueNegativeTestJSON-1760443836</nova:project>
Oct 20 16:45:27 user nova-compute[74131]:       </nova:owner>
Oct 20 16:45:27 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:45:27 user nova-compute[74131]:       <nova:ports>
Oct 20 16:45:27 user nova-compute[74131]:         <nova:port uuid="b203dd7e-1fcd-4c66-a7c0-69079cb17f1f">
Oct 20 16:45:27 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 16:45:27 user nova-compute[74131]:         </nova:port>
Oct 20 16:45:27 user nova-compute[74131]:       </nova:ports>
Oct 20 16:45:27 user nova-compute[74131]:     </nova:instance>
Oct 20 16:45:27 user nova-compute[74131]:   </metadata>
Oct 20 16:45:27 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:45:27 user nova-compute[74131]:     <system>
Oct 20 16:45:27 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:45:27 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:45:27 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:45:27 user nova-compute[74131]:       <entry name="serial">72c13338-0ecf-4383-a9db-b316bda13601</entry>
Oct 20 16:45:27 user nova-compute[74131]:       <entry name="uuid">72c13338-0ecf-4383-a9db-b316bda13601</entry>
Oct 20 16:45:27 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:45:27 user nova-compute[74131]:     </system>
Oct 20 16:45:27 user nova-compute[74131]:   </sysinfo>
Oct 20 16:45:27 user nova-compute[74131]:   <os>
Oct 20 16:45:27 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:45:27 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:45:27 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:45:27 user nova-compute[74131]:   </os>
Oct 20 16:45:27 user nova-compute[74131]:   <features>
Oct 20 16:45:27 user nova-compute[74131]:     <acpi/>
Oct 20 16:45:27 user nova-compute[74131]:     <apic/>
Oct 20 16:45:27 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:45:27 user nova-compute[74131]:   </features>
Oct 20 16:45:27 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:45:27 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:45:27 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:45:27 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:45:27 user nova-compute[74131]:   </clock>
Oct 20 16:45:27 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:45:27 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:45:27 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:45:27 user nova-compute[74131]:   </cpu>
Oct 20 16:45:27 user nova-compute[74131]:   <devices>
Oct 20 16:45:27 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:45:27 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:45:27 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk"/>
Oct 20 16:45:27 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:45:27 user nova-compute[74131]:     </disk>
Oct 20 16:45:27 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:45:27 user nova-compute[74131]:       <mac address="fa:16:3e:fa:8a:ae"/>
Oct 20 16:45:27 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:45:27 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:45:27 user nova-compute[74131]:       <target dev="tapb203dd7e-1f"/>
Oct 20 16:45:27 user nova-compute[74131]:     </interface>
Oct 20 16:45:27 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:45:27 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/console.log" append="off"/>
Oct 20 16:45:27 user nova-compute[74131]:     </serial>
Oct 20 16:45:27 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:45:27 user nova-compute[74131]:     <video>
Oct 20 16:45:27 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:45:27 user nova-compute[74131]:     </video>
Oct 20 16:45:27 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:45:27 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:45:27 user nova-compute[74131]:     </rng>
Oct 20 16:45:27 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:45:27 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:45:27 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:45:27 user nova-compute[74131]:     </memballoon>
Oct 20 16:45:27 user nova-compute[74131]:   </devices>
Oct 20 16:45:27 user nova-compute[74131]: </domain>
Oct 20 16:45:27 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-903614781',display_name='tempest-ServerRescueNegativeTestJSON-server-903614781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-903614781',id=44,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-wvb9jdcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:45:25Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=72c13338-0ecf-4383-a9db-b316bda13601,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG os_vif [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7fad7239-ea10-5df3-a4e0-71f72152a8cb', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Cannot resize image /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Ensure instance console log exists: /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb203dd7e-1f, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb203dd7e-1f, col_values=(('qos', UUID('ae686a71-8274-481c-b5b7-8318fcbd554f')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb203dd7e-1f, col_values=(('external_ids', {'iface-id': 'b203dd7e-1fcd-4c66-a7c0-69079cb17f1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:8a:ae', 'vm-uuid': '72c13338-0ecf-4383-a9db-b316bda13601'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:27 user nova-compute[74131]: INFO os_vif [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f')
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No VIF found with MAC fa:16:3e:fa:8a:ae, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Successfully updated port: 8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-changed-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Refreshing instance network info cache due to event network-changed-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updated VIF entry in instance network info cache for port b203dd7e-1fcd-4c66-a7c0-69079cb17f1f. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-877a1b1b-ab32-4984-bfc3-761e2a235150 req-7f627ba7-5446-48f3-9bef-879342f5488e service nova] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance network_info: |[{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Refreshing network info cache for port 8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Start _get_guest_xml network_info=[{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:45:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:45:27 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851827302',display_name='tempest-ServerRescueNegativeTestJSON-server-1851827302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851827302',id=45,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-p459o8s1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:45:26Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=a32a162c-9a8f-4b69-95e0-425f75d234bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:27 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.objects.instance [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'pci_devices' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:45:28 user nova-compute[74131]:   <uuid>a32a162c-9a8f-4b69-95e0-425f75d234bf</uuid>
Oct 20 16:45:28 user nova-compute[74131]:   <name>instance-0000002d</name>
Oct 20 16:45:28 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:45:28 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:45:28 user nova-compute[74131]:   <metadata>
Oct 20 16:45:28 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:45:28 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:45:28 user nova-compute[74131]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1851827302</nova:name>
Oct 20 16:45:28 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:45:27</nova:creationTime>
Oct 20 16:45:28 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:45:28 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:45:28 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:45:28 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:45:28 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:45:28 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:45:28 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:45:28 user nova-compute[74131]:       <nova:owner>
Oct 20 16:45:28 user nova-compute[74131]:         <nova:user uuid="5bc5139a72784dc8b85c3a17b9ce722d">tempest-ServerRescueNegativeTestJSON-1760443836-project-member</nova:user>
Oct 20 16:45:28 user nova-compute[74131]:         <nova:project uuid="368249a7186c4968a3b8d8fa5fbd8737">tempest-ServerRescueNegativeTestJSON-1760443836</nova:project>
Oct 20 16:45:28 user nova-compute[74131]:       </nova:owner>
Oct 20 16:45:28 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:45:28 user nova-compute[74131]:       <nova:ports>
Oct 20 16:45:28 user nova-compute[74131]:         <nova:port uuid="8acbb837-c91e-4feb-a2f1-dd0db1c69dd6">
Oct 20 16:45:28 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:45:28 user nova-compute[74131]:         </nova:port>
Oct 20 16:45:28 user nova-compute[74131]:       </nova:ports>
Oct 20 16:45:28 user nova-compute[74131]:     </nova:instance>
Oct 20 16:45:28 user nova-compute[74131]:   </metadata>
Oct 20 16:45:28 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:45:28 user nova-compute[74131]:     <system>
Oct 20 16:45:28 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:45:28 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:45:28 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:45:28 user nova-compute[74131]:       <entry name="serial">a32a162c-9a8f-4b69-95e0-425f75d234bf</entry>
Oct 20 16:45:28 user nova-compute[74131]:       <entry name="uuid">a32a162c-9a8f-4b69-95e0-425f75d234bf</entry>
Oct 20 16:45:28 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:45:28 user nova-compute[74131]:     </system>
Oct 20 16:45:28 user nova-compute[74131]:   </sysinfo>
Oct 20 16:45:28 user nova-compute[74131]:   <os>
Oct 20 16:45:28 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:45:28 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:45:28 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:45:28 user nova-compute[74131]:   </os>
Oct 20 16:45:28 user nova-compute[74131]:   <features>
Oct 20 16:45:28 user nova-compute[74131]:     <acpi/>
Oct 20 16:45:28 user nova-compute[74131]:     <apic/>
Oct 20 16:45:28 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:45:28 user nova-compute[74131]:   </features>
Oct 20 16:45:28 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:45:28 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:45:28 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:45:28 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:45:28 user nova-compute[74131]:   </clock>
Oct 20 16:45:28 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:45:28 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:45:28 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:45:28 user nova-compute[74131]:   </cpu>
Oct 20 16:45:28 user nova-compute[74131]:   <devices>
Oct 20 16:45:28 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:45:28 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:45:28 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk"/>
Oct 20 16:45:28 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:45:28 user nova-compute[74131]:     </disk>
Oct 20 16:45:28 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:45:28 user nova-compute[74131]:       <mac address="fa:16:3e:49:b4:2c"/>
Oct 20 16:45:28 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:45:28 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:45:28 user nova-compute[74131]:       <target dev="tap8acbb837-c9"/>
Oct 20 16:45:28 user nova-compute[74131]:     </interface>
Oct 20 16:45:28 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:45:28 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/console.log" append="off"/>
Oct 20 16:45:28 user nova-compute[74131]:     </serial>
Oct 20 16:45:28 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:45:28 user nova-compute[74131]:     <video>
Oct 20 16:45:28 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:45:28 user nova-compute[74131]:     </video>
Oct 20 16:45:28 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:45:28 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:45:28 user nova-compute[74131]:     </rng>
Oct 20 16:45:28 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:45:28 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:45:28 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:45:28 user nova-compute[74131]:     </memballoon>
Oct 20 16:45:28 user nova-compute[74131]:   </devices>
Oct 20 16:45:28 user nova-compute[74131]: </domain>
Oct 20 16:45:28 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851827302',display_name='tempest-ServerRescueNegativeTestJSON-server-1851827302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851827302',id=45,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-p459o8s1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:45:26Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=a32a162c-9a8f-4b69-95e0-425f75d234bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG os_vif [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b80152a0-09aa-59a5-9366-d1389197fdcc', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8acbb837-c9, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8acbb837-c9, col_values=(('qos', UUID('21c12c49-6f4b-4657-bf4d-4085af24199d')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8acbb837-c9, col_values=(('external_ids', {'iface-id': '8acbb837-c91e-4feb-a2f1-dd0db1c69dd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:b4:2c', 'vm-uuid': 'a32a162c-9a8f-4b69-95e0-425f75d234bf'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:28 user nova-compute[74131]: INFO os_vif [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9')
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No VIF found with MAC fa:16:3e:49:b4:2c, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updated VIF entry in instance network info cache for port 8acbb837-c91e-4feb-a2f1-dd0db1c69dd6. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3327b641-91a7-48c1-81c1-8e4ea0cc722b req-16e02c00-bc53-4f2d-8a2f-62fde449ca3c service nova] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:45:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-14a61fe6-6ff1-4550-af9c-34d36f2b8787 req-1d63e4f1-c245-4e16-9c08-f97319093d61 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-14a61fe6-6ff1-4550-af9c-34d36f2b8787 req-1d63e4f1-c245-4e16-9c08-f97319093d61 service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-14a61fe6-6ff1-4550-af9c-34d36f2b8787 req-1d63e4f1-c245-4e16-9c08-f97319093d61 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-14a61fe6-6ff1-4550-af9c-34d36f2b8787 req-1d63e4f1-c245-4e16-9c08-f97319093d61 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-14a61fe6-6ff1-4550-af9c-34d36f2b8787 req-1d63e4f1-c245-4e16-9c08-f97319093d61 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:29 user nova-compute[74131]: WARNING nova.compute.manager [req-14a61fe6-6ff1-4550-af9c-34d36f2b8787 req-1d63e4f1-c245-4e16-9c08-f97319093d61 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state building and task_state spawning.
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-06c3ae67-fd34-46d8-82d8-68ce79d9e2c6 req-2f7a1f70-2bbe-4549-aeeb-a8664e73cf07 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-06c3ae67-fd34-46d8-82d8-68ce79d9e2c6 req-2f7a1f70-2bbe-4549-aeeb-a8664e73cf07 service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-06c3ae67-fd34-46d8-82d8-68ce79d9e2c6 req-2f7a1f70-2bbe-4549-aeeb-a8664e73cf07 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-06c3ae67-fd34-46d8-82d8-68ce79d9e2c6 req-2f7a1f70-2bbe-4549-aeeb-a8664e73cf07 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG nova.compute.manager [req-06c3ae67-fd34-46d8-82d8-68ce79d9e2c6 req-2f7a1f70-2bbe-4549-aeeb-a8664e73cf07 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:30 user nova-compute[74131]: WARNING nova.compute.manager [req-06c3ae67-fd34-46d8-82d8-68ce79d9e2c6 req-2f7a1f70-2bbe-4549-aeeb-a8664e73cf07 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received unexpected event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with vm_state building and task_state spawning.
Oct 20 16:45:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-bcd348c6-548b-475e-b5d9-ac2927529d1e req-bd05ff7d-04b1-4b13-aaab-bc1f18d7b5fa service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bcd348c6-548b-475e-b5d9-ac2927529d1e req-bd05ff7d-04b1-4b13-aaab-bc1f18d7b5fa service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bcd348c6-548b-475e-b5d9-ac2927529d1e req-bd05ff7d-04b1-4b13-aaab-bc1f18d7b5fa service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-bcd348c6-548b-475e-b5d9-ac2927529d1e req-bd05ff7d-04b1-4b13-aaab-bc1f18d7b5fa service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-bcd348c6-548b-475e-b5d9-ac2927529d1e req-bd05ff7d-04b1-4b13-aaab-bc1f18d7b5fa service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:31 user nova-compute[74131]: WARNING nova.compute.manager [req-bcd348c6-548b-475e-b5d9-ac2927529d1e req-bd05ff7d-04b1-4b13-aaab-bc1f18d7b5fa service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state building and task_state spawning.
Oct 20 16:45:31 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:45:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:45:32 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance spawned successfully.
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:45:32 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance spawned successfully.
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:45:32 user nova-compute[74131]: INFO nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Took 7.60 seconds to spawn the instance on the hypervisor.
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-ac65a87c-8937-43c8-82d3-f9251b547dfc req-ee04d170-e9fd-4c98-8c65-1176d28f111d service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ac65a87c-8937-43c8-82d3-f9251b547dfc req-ee04d170-e9fd-4c98-8c65-1176d28f111d service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ac65a87c-8937-43c8-82d3-f9251b547dfc req-ee04d170-e9fd-4c98-8c65-1176d28f111d service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ac65a87c-8937-43c8-82d3-f9251b547dfc req-ee04d170-e9fd-4c98-8c65-1176d28f111d service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-ac65a87c-8937-43c8-82d3-f9251b547dfc req-ee04d170-e9fd-4c98-8c65-1176d28f111d service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:32 user nova-compute[74131]: WARNING nova.compute.manager [req-ac65a87c-8937-43c8-82d3-f9251b547dfc req-ee04d170-e9fd-4c98-8c65-1176d28f111d service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received unexpected event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with vm_state building and task_state spawning.
Oct 20 16:45:32 user nova-compute[74131]: INFO nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Took 6.30 seconds to spawn the instance on the hypervisor.
Oct 20 16:45:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:45:32 user nova-compute[74131]: INFO nova.compute.manager [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Took 8.54 seconds to build instance.
Oct 20 16:45:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-45160b67-214e-47c2-89ba-fac5306b975f tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "72c13338-0ecf-4383-a9db-b316bda13601" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.644s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:32 user nova-compute[74131]: INFO nova.compute.manager [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Took 7.46 seconds to build instance.
Oct 20 16:45:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cc462016-d535-4017-b23d-f6ec062a5e9d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.636s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-changed-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Refreshing instance network info cache due to event network-changed-87d1bab3-aa28-4828-ae22-d44ff072cd97. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:45:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] Acquiring lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:45:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] Acquired lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:45:33 user nova-compute[74131]: DEBUG nova.network.neutron [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Refreshing network info cache for port 87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updated VIF entry in instance network info cache for port 87d1bab3-aa28-4828-ae22-d44ff072cd97. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updating instance_info_cache with network_info: [{"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9984b775-773e-4258-9167-127e9c7ac2b6 req-5b00cae6-153a-41dc-841d-fb52eea2c2ec service nova] Releasing lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-changed-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Refreshing instance network info cache due to event network-changed-87d1bab3-aa28-4828-ae22-d44ff072cd97. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] Acquiring lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] Acquired lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG nova.network.neutron [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Refreshing network info cache for port 87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "52e980d6-bf45-4bef-8e96-197911a2b57a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:34 user nova-compute[74131]: INFO nova.compute.manager [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Terminating instance
Oct 20 16:45:34 user nova-compute[74131]: DEBUG nova.compute.manager [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updated VIF entry in instance network info cache for port 87d1bab3-aa28-4828-ae22-d44ff072cd97. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updating instance_info_cache with network_info: [{"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-dd73676a-ff70-43d3-a2f8-2b7acc3a9656 req-91e2507a-1834-4118-8866-1a9a4852903e service nova] Releasing lock "refresh_cache-52e980d6-bf45-4bef-8e96-197911a2b57a" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Instance destroyed successfully.
Oct 20 16:45:35 user nova-compute[74131]: DEBUG nova.objects.instance [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'resources' on Instance uuid 52e980d6-bf45-4bef-8e96-197911a2b57a {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-800600043',display_name='tempest-TestVolumeBootPattern-server-800600043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-800600043',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:44:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-5oph2ico',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:44:11Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=52e980d6-bf45-4bef-8e96-197911a2b57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "address": "fa:16:3e:45:3e:85", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d1bab3-aa", "ovs_interfaceid": "87d1bab3-aa28-4828-ae22-d44ff072cd97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:3e:85,bridge_name='br-int',has_traffic_filtering=True,id=87d1bab3-aa28-4828-ae22-d44ff072cd97,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d1bab3-aa') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_vif [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:3e:85,bridge_name='br-int',has_traffic_filtering=True,id=87d1bab3-aa28-4828-ae22-d44ff072cd97,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d1bab3-aa') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87d1bab3-aa, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a53b3e9-9942-4a4e-8cc0-0cd75929910f) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:35 user nova-compute[74131]: INFO os_vif [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:3e:85,bridge_name='br-int',has_traffic_filtering=True,id=87d1bab3-aa28-4828-ae22-d44ff072cd97,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d1bab3-aa')
Oct 20 16:45:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSbXkUlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:45:35 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b80bab-405a-46ce-a80a-705729370fbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:45:35 user nova-compute[74131]: No targets found.
Oct 20 16:45:35 user nova-compute[74131]: iSNS:
Oct 20 16:45:35 user nova-compute[74131]: No targets found.
Oct 20 16:45:35 user nova-compute[74131]: STATIC:
Oct 20 16:45:35 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:45:35 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:45:35 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:45:35 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2
Oct 20 16:45:35 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:45:35 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:45:35 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:45:35 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:45:35 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:45:35 user nova-compute[74131]: FIRMWARE:
Oct 20 16:45:35 user nova-compute[74131]: No targets found.
Oct 20 16:45:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:45:35 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:45:35 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39547799-8741-49ad-a65b-301c3c216234]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a0c917-5b85-4fe0-b5f3-7a0ca03a63d4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:45:35 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:45:35 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:45:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:45:35 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:45:35 user nova-compute[74131]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 (non-flash)
Oct 20 16:45:35 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:45:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c86d8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa120585-f4c6-4e35-ac6e-087ba57b8b6f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aea4ba9-decf-4e37-bf18-ad3cbd54d8a8]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a21e92-e395-47bf-89a6-6b7a6d42fac9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ccbf55-07a3-45e2-9221-32ec0bb6eb50]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529f05c-2c32-4f2f-a79c-111529b1a51a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d00f7c-2e40-4f5f-bec8-6133c862bf3f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260]
Oct 20 16:45:36 user nova-compute[74131]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2, portal: 172.16.0.220,3260] successful.
Oct 20 16:45:36 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a45cbc-3fb7-4fbf-a5fc-5f1475d54ca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[119de80f-db9b-41ab-ad8b-717cd83c8c2b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== disconnect_volume: return (358ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:45:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Deleting instance files /opt/stack/data/nova/instances/52e980d6-bf45-4bef-8e96-197911a2b57a_del
Oct 20 16:45:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Deletion of /opt/stack/data/nova/instances/52e980d6-bf45-4bef-8e96-197911a2b57a_del complete
Oct 20 16:45:36 user nova-compute[74131]: INFO nova.compute.manager [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-vif-unplugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] Acquiring lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] No waiting events found dispatching network-vif-unplugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-vif-unplugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] Acquiring lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] No waiting events found dispatching network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:36 user nova-compute[74131]: WARNING nova.compute.manager [req-aa3f496d-bd87-49aa-ab7f-efe74cf7b911 req-3ad42c46-732d-477f-bb25-67b326b8f83c service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received unexpected event network-vif-plugged-87d1bab3-aa28-4828-ae22-d44ff072cd97 for instance with vm_state active and task_state deleting.
Oct 20 16:45:37 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:37 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Took 0.82 seconds to deallocate network for instance.
Oct 20 16:45:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-f2017b72-fc3f-4637-8f7d-6ec81f755d48 req-5b2d5e4f-2ee3-485e-99b1-d23d3d5dbfa4 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Received event network-vif-deleted-87d1bab3-aa28-4828-ae22-d44ff072cd97 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:37 user nova-compute[74131]: INFO nova.compute.manager [req-f2017b72-fc3f-4637-8f7d-6ec81f755d48 req-5b2d5e4f-2ee3-485e-99b1-d23d3d5dbfa4 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Neutron deleted interface 87d1bab3-aa28-4828-ae22-d44ff072cd97; detaching it from the instance and deleting it from the info cache
Oct 20 16:45:37 user nova-compute[74131]: DEBUG nova.network.neutron [req-f2017b72-fc3f-4637-8f7d-6ec81f755d48 req-5b2d5e4f-2ee3-485e-99b1-d23d3d5dbfa4 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-f2017b72-fc3f-4637-8f7d-6ec81f755d48 req-5b2d5e4f-2ee3-485e-99b1-d23d3d5dbfa4 service nova] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Detach interface failed, port_id=87d1bab3-aa28-4828-ae22-d44ff072cd97, reason: Instance 52e980d6-bf45-4bef-8e96-197911a2b57a could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:45:38 user nova-compute[74131]: INFO nova.compute.manager [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 52e980d6-bf45-4bef-8e96-197911a2b57a] Took 0.96 seconds to detach 1 volumes for instance.
Oct 20 16:45:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:45:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:38 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Deleted allocations for instance 52e980d6-bf45-4bef-8e96-197911a2b57a
Oct 20 16:45:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-eb5b500c-7fd2-40cf-8cc0-a7bb7a57a416 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "52e980d6-bf45-4bef-8e96-197911a2b57a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.013s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:45:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:40 user nova-compute[74131]: INFO nova.compute.manager [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Terminating instance
Oct 20 16:45:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-a037c15c-4ef6-482e-8410-995996cb53da req-51f10797-212e-43c6-b27e-42c8aaaa6c89 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a037c15c-4ef6-482e-8410-995996cb53da req-51f10797-212e-43c6-b27e-42c8aaaa6c89 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a037c15c-4ef6-482e-8410-995996cb53da req-51f10797-212e-43c6-b27e-42c8aaaa6c89 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a037c15c-4ef6-482e-8410-995996cb53da req-51f10797-212e-43c6-b27e-42c8aaaa6c89 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-a037c15c-4ef6-482e-8410-995996cb53da req-51f10797-212e-43c6-b27e-42c8aaaa6c89 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG nova.compute.manager [req-a037c15c-4ef6-482e-8410-995996cb53da req-51f10797-212e-43c6-b27e-42c8aaaa6c89 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-unplugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Instance destroyed successfully.
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.objects.instance [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'resources' on Instance uuid 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-92896468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-92896468',id=24,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-4pjv3am7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:33:38Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "464ba822-ba37-482b-9a97-7bea0352d5d3", "address": "fa:16:3e:c7:90:5d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464ba822-ba", "ovs_interfaceid": "464ba822-ba37-482b-9a97-7bea0352d5d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_vif [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap464ba822-ba, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8589099c-6e83-46b6-8e1c-4edfd4ae624b) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:41 user nova-compute[74131]: INFO os_vif [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:90:5d,bridge_name='br-int',has_traffic_filtering=True,id=464ba822-ba37-482b-9a97-7bea0352d5d3,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464ba822-ba')
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUGtmSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:45:41 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb37b91c-34b3-48a1-a1a6-44329a749cc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:45:41 user nova-compute[74131]: No targets found.
Oct 20 16:45:41 user nova-compute[74131]: iSNS:
Oct 20 16:45:41 user nova-compute[74131]: No targets found.
Oct 20 16:45:41 user nova-compute[74131]: STATIC:
Oct 20 16:45:41 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:45:41 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:45:41 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:45:41 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe
Oct 20 16:45:41 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:45:41 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:45:41 user nova-compute[74131]: FIRMWARE:
Oct 20 16:45:41 user nova-compute[74131]: No targets found.
Oct 20 16:45:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:45:41 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:45:41 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65718bf-b444-4947-8e05-3a08e8c06747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfc5dbf-4b97-4494-b839-09acc3d22e30]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:45:41 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:45:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe (non-flash)
Oct 20 16:45:41 user nova-compute[74131]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:45:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a86ea680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe'): ({'sdc'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Removing single pathed devices sdc {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2081a0-ab99-468f-a7b3-00f9d509abfa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e47293-34c6-4cd1-b1a6-6ef59d7bf3bb]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Flushing IO for device /dev/sdc {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af92151-ba19-4169-af37-56a64b899a6d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6469cf-5c52-43db-819f-acbc7ed7751a]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d955bad-1c9d-4ab6-8869-d60ff30fd25f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[61710f7a-5bd4-4a2c-a51f-c69067430c3a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260]
Oct 20 16:45:41 user nova-compute[74131]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe, portal: 172.16.0.220,3260] successful.
Oct 20 16:45:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48da990f-1ed3-4d55-b607-f5bb688f72fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[484106df-6d3b-4af2-8c37-e8832389c14e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] <== disconnect_volume: return (350ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:45:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Deleting instance files /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0_del
Oct 20 16:45:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Deletion of /opt/stack/data/nova/instances/3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0_del complete
Oct 20 16:45:41 user nova-compute[74131]: INFO nova.compute.manager [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 20 16:45:41 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:45:41 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:42 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Took 0.82 seconds to deallocate network for instance.
Oct 20 16:45:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-ed4816c0-81ce-49a6-8ca2-806fc4d34e1f req-f7e46713-5d27-4c00-9dc9-c223b0268d40 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ed4816c0-81ce-49a6-8ca2-806fc4d34e1f req-f7e46713-5d27-4c00-9dc9-c223b0268d40 service nova] Acquiring lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ed4816c0-81ce-49a6-8ca2-806fc4d34e1f req-f7e46713-5d27-4c00-9dc9-c223b0268d40 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ed4816c0-81ce-49a6-8ca2-806fc4d34e1f req-f7e46713-5d27-4c00-9dc9-c223b0268d40 service nova] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-ed4816c0-81ce-49a6-8ca2-806fc4d34e1f req-f7e46713-5d27-4c00-9dc9-c223b0268d40 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] No waiting events found dispatching network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:42 user nova-compute[74131]: WARNING nova.compute.manager [req-ed4816c0-81ce-49a6-8ca2-806fc4d34e1f req-f7e46713-5d27-4c00-9dc9-c223b0268d40 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received unexpected event network-vif-plugged-464ba822-ba37-482b-9a97-7bea0352d5d3 for instance with vm_state active and task_state deleting.
Oct 20 16:45:42 user nova-compute[74131]: DEBUG nova.compute.manager [req-ed4816c0-81ce-49a6-8ca2-806fc4d34e1f req-f7e46713-5d27-4c00-9dc9-c223b0268d40 service nova] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Received event network-vif-deleted-464ba822-ba37-482b-9a97-7bea0352d5d3 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:45:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:43 user nova-compute[74131]: INFO nova.compute.manager [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0] Took 1.00 seconds to detach 1 volumes for instance.
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:43 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Deleted allocations for instance 3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b6e3f9a4-2294-4368-8e9f-447d7a4cc057 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "3b9791c0-b3c8-4734-bb3d-d3963b5d4ef0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.743s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:45:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:45:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:45:45 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:45:45 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8262MB free_disk=25.033138275146484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 562d3ea2-1242-44ef-938c-7e2113d46496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2ae75eb1-f460-4304-aebd-541775743e3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:46 user nova-compute[74131]: INFO nova.compute.manager [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Terminating instance
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-07e37aff-8ea6-400a-b1eb-9674ea8d897f req-bc91ebba-9fe4-49bb-ae08-8dd904a05811 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07e37aff-8ea6-400a-b1eb-9674ea8d897f req-bc91ebba-9fe4-49bb-ae08-8dd904a05811 service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07e37aff-8ea6-400a-b1eb-9674ea8d897f req-bc91ebba-9fe4-49bb-ae08-8dd904a05811 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-07e37aff-8ea6-400a-b1eb-9674ea8d897f req-bc91ebba-9fe4-49bb-ae08-8dd904a05811 service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-07e37aff-8ea6-400a-b1eb-9674ea8d897f req-bc91ebba-9fe4-49bb-ae08-8dd904a05811 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-07e37aff-8ea6-400a-b1eb-9674ea8d897f req-bc91ebba-9fe4-49bb-ae08-8dd904a05811 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-unplugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Instance destroyed successfully.
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'resources' on Instance uuid f77f165e-a8f0-4352-b8d0-bb48cf325369 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-57709410',display_name='tempest-AttachVolumeTestJSON-server-57709410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-57709410',id=35,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzCRr+vOEtK+P5tgifSfP7J70lQFr3wjHCgnJKcF+wB0RT+sAocRV0diuyosp2J0xuYkPtWF6buJaYxPpRjunEYx87eAXkoNQY8Sw+3jGp7xzwuw3NgGLsmPwaMa5qjQ==',key_name='tempest-keypair-223136488',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-nn8lwk63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=f77f165e-a8f0-4352-b8d0-bb48cf325369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "334ce2d7-c655-430b-8c98-25c37e643e6a", "address": "fa:16:3e:28:94:04", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334ce2d7-c6", "ovs_interfaceid": "334ce2d7-c655-430b-8c98-25c37e643e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG os_vif [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap334ce2d7-c6, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f177b4ff-1af8-44df-8d41-6ec9625d4aa6) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:46 user nova-compute[74131]: INFO os_vif [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:94:04,bridge_name='br-int',has_traffic_filtering=True,id=334ce2d7-c655-430b-8c98-25c37e643e6a,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334ce2d7-c6')
Oct 20 16:45:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Deleting instance files /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369_del
Oct 20 16:45:46 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Deletion of /opt/stack/data/nova/instances/f77f165e-a8f0-4352-b8d0-bb48cf325369_del complete
Oct 20 16:45:46 user nova-compute[74131]: INFO nova.compute.manager [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 16:45:46 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:45:46 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:45:47 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:47 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Took 0.82 seconds to deallocate network for instance.
Oct 20 16:45:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-90b0d641-4e61-4d3b-8916-71b7cbd9a609 req-43aacdb0-72c1-408d-9583-d74d5e57a713 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-deleted-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:47 user nova-compute[74131]: INFO nova.compute.manager [req-90b0d641-4e61-4d3b-8916-71b7cbd9a609 req-43aacdb0-72c1-408d-9583-d74d5e57a713 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Neutron deleted interface 334ce2d7-c655-430b-8c98-25c37e643e6a; detaching it from the instance and deleting it from the info cache
Oct 20 16:45:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-90b0d641-4e61-4d3b-8916-71b7cbd9a609 req-43aacdb0-72c1-408d-9583-d74d5e57a713 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:45:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-90b0d641-4e61-4d3b-8916-71b7cbd9a609 req-43aacdb0-72c1-408d-9583-d74d5e57a713 service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Detach interface failed, port_id=334ce2d7-c655-430b-8c98-25c37e643e6a, reason: Instance f77f165e-a8f0-4352-b8d0-bb48cf325369 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:45:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:47 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:45:47 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:45:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:48 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Deleted allocations for instance f77f165e-a8f0-4352-b8d0-bb48cf325369
Oct 20 16:45:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e792d537-dd72-45d6-802b-b3b3358f2b77 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-62f96ed4-075a-4aa4-9a9b-31928f5142e3 req-765be319-27a7-42ee-ad3f-826bce9116ec service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:45:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62f96ed4-075a-4aa4-9a9b-31928f5142e3 req-765be319-27a7-42ee-ad3f-826bce9116ec service nova] Acquiring lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:45:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62f96ed4-075a-4aa4-9a9b-31928f5142e3 req-765be319-27a7-42ee-ad3f-826bce9116ec service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:45:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-62f96ed4-075a-4aa4-9a9b-31928f5142e3 req-765be319-27a7-42ee-ad3f-826bce9116ec service nova] Lock "f77f165e-a8f0-4352-b8d0-bb48cf325369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:45:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-62f96ed4-075a-4aa4-9a9b-31928f5142e3 req-765be319-27a7-42ee-ad3f-826bce9116ec service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] No waiting events found dispatching network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:45:48 user nova-compute[74131]: WARNING nova.compute.manager [req-62f96ed4-075a-4aa4-9a9b-31928f5142e3 req-765be319-27a7-42ee-ad3f-826bce9116ec service nova] [instance: f77f165e-a8f0-4352-b8d0-bb48cf325369] Received unexpected event network-vif-plugged-334ce2d7-c655-430b-8c98-25c37e643e6a for instance with vm_state deleted and task_state None.
Oct 20 16:45:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:45:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 562d3ea2-1242-44ef-938c-7e2113d46496 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 2ae75eb1-f460-4304-aebd-541775743e3f {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "2ae75eb1-f460-4304-aebd-541775743e3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "72c13338-0ecf-4383-a9db-b316bda13601" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "2ae75eb1-f460-4304-aebd-541775743e3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "72c13338-0ecf-4383-a9db-b316bda13601" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:46:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:46:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:46:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:29 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:31 user nova-compute[74131]: INFO nova.compute.manager [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Terminating instance
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-e765c2af-f541-4be5-b633-da2df28a28c0 req-59ddbc7a-637f-4fe1-9050-55d24d8bc560 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received event network-vif-unplugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e765c2af-f541-4be5-b633-da2df28a28c0 req-59ddbc7a-637f-4fe1-9050-55d24d8bc560 service nova] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e765c2af-f541-4be5-b633-da2df28a28c0 req-59ddbc7a-637f-4fe1-9050-55d24d8bc560 service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e765c2af-f541-4be5-b633-da2df28a28c0 req-59ddbc7a-637f-4fe1-9050-55d24d8bc560 service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-e765c2af-f541-4be5-b633-da2df28a28c0 req-59ddbc7a-637f-4fe1-9050-55d24d8bc560 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] No waiting events found dispatching network-vif-unplugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-e765c2af-f541-4be5-b633-da2df28a28c0 req-59ddbc7a-637f-4fe1-9050-55d24d8bc560 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received event network-vif-unplugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Instance destroyed successfully.
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.objects.instance [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lazy-loading 'resources' on Instance uuid 562d3ea2-1242-44ef-938c-7e2113d46496 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-667768035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-667768035',id=19,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097a2eccca244cbfa897e6a573a3113d',ramdisk_id='',reservation_id='r-t3u0f8ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-131352591',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:28:50Z,user_data=None,user_id='a82534b86e314f00896042e2e684a623',uuid=562d3ea2-1242-44ef-938c-7e2113d46496,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converting VIF {"id": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "address": "fa:16:3e:87:30:4d", "network": {"id": "4895256d-6bea-415e-b559-3daa405b4dfe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011959423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097a2eccca244cbfa897e6a573a3113d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff6c710-c3", "ovs_interfaceid": "1ff6c710-c3ec-4e8a-871b-5fb62df7315b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:30:4d,bridge_name='br-int',has_traffic_filtering=True,id=1ff6c710-c3ec-4e8a-871b-5fb62df7315b,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff6c710-c3') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG os_vif [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:30:4d,bridge_name='br-int',has_traffic_filtering=True,id=1ff6c710-c3ec-4e8a-871b-5fb62df7315b,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff6c710-c3') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ff6c710-c3, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e6cbdb1-8cdb-4200-92db-9e31f3fbdf12) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:31 user nova-compute[74131]: INFO os_vif [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:30:4d,bridge_name='br-int',has_traffic_filtering=True,id=1ff6c710-c3ec-4e8a-871b-5fb62df7315b,network=Network(4895256d-6bea-415e-b559-3daa405b4dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff6c710-c3')
Oct 20 16:46:31 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Deleting instance files /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496_del
Oct 20 16:46:31 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Deletion of /opt/stack/data/nova/instances/562d3ea2-1242-44ef-938c-7e2113d46496_del complete
Oct 20 16:46:31 user nova-compute[74131]: INFO nova.compute.manager [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Took 0.80 seconds to destroy the instance on the hypervisor.
Oct 20 16:46:31 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:46:31 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:46:32 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:46:32 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Took 0.52 seconds to deallocate network for instance.
Oct 20 16:46:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:32 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:46:32 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:46:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:32 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Deleted allocations for instance 562d3ea2-1242-44ef-938c-7e2113d46496
Oct 20 16:46:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-758b95b5-2497-401b-b940-4dd35e32a227 tempest-ServerBootFromVolumeStableRescueTest-131352591 tempest-ServerBootFromVolumeStableRescueTest-131352591-project-member] Lock "562d3ea2-1242-44ef-938c-7e2113d46496" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-02f2c49d-8757-4780-aafb-9be1a88d9711 req-7fefc9ad-1e8a-4ac5-bb6f-67649d0e2eb5 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received event network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-02f2c49d-8757-4780-aafb-9be1a88d9711 req-7fefc9ad-1e8a-4ac5-bb6f-67649d0e2eb5 service nova] Acquiring lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-02f2c49d-8757-4780-aafb-9be1a88d9711 req-7fefc9ad-1e8a-4ac5-bb6f-67649d0e2eb5 service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-02f2c49d-8757-4780-aafb-9be1a88d9711 req-7fefc9ad-1e8a-4ac5-bb6f-67649d0e2eb5 service nova] Lock "562d3ea2-1242-44ef-938c-7e2113d46496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-02f2c49d-8757-4780-aafb-9be1a88d9711 req-7fefc9ad-1e8a-4ac5-bb6f-67649d0e2eb5 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] No waiting events found dispatching network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:33 user nova-compute[74131]: WARNING nova.compute.manager [req-02f2c49d-8757-4780-aafb-9be1a88d9711 req-7fefc9ad-1e8a-4ac5-bb6f-67649d0e2eb5 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received unexpected event network-vif-plugged-1ff6c710-c3ec-4e8a-871b-5fb62df7315b for instance with vm_state deleted and task_state None.
Oct 20 16:46:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-02f2c49d-8757-4780-aafb-9be1a88d9711 req-7fefc9ad-1e8a-4ac5-bb6f-67649d0e2eb5 service nova] [instance: 562d3ea2-1242-44ef-938c-7e2113d46496] Received event network-vif-deleted-1ff6c710-c3ec-4e8a-871b-5fb62df7315b {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:46:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:37 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:46:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:40 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:40 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:46:40 user nova-compute[74131]: INFO nova.compute.claims [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Claim successful on node user
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:46:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.policy [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea2a757da8e46dda15f3e996a94940f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795f458a4c844238e9dece3464d4b69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:46:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Creating image(s)
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "/opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "/opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.192s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Skipping network cache update for instance because it is Building. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 2ae75eb1-f460-4304-aebd-541775743e3f {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk 1073741824" returned: 0 in 0.060s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Successfully created port: 0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Cannot resize image /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Ensure instance console log exists: /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating instance_info_cache with network_info: [{"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Successfully updated port: 0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:46:42 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquired lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-changed-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Refreshing instance network info cache due to event network-changed-0a0e606d-842a-409c-a7e4-c5b29365f756. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] Acquiring lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updating instance_info_cache with network_info: [{"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Releasing lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Instance network_info: |[{"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] Acquired lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.neutron [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Refreshing network info cache for port 0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Start _get_guest_xml network_info=[{"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:46:43 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:46:43 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2009212484',display_name='tempest-AttachVolumeTestJSON-server-2009212484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2009212484',id=46,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4MWOULKoqZJcWJUFv7FDUdpYhRCyAODTOTkqEUa3mtNdPIZqjOiaKSraIP1jYrp5RuNMQHvPbkuJcHjyXMGAgc1tbyS9wFLmRnBR279graZYOKFCGNhn0wmfFpHTtGWA==',key_name='tempest-keypair-1934026091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-wd2huwk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=4ca71861-05ab-442e-a07b-e86480a930fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3e:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a0e606d-842a-409c-a7e4-c5b29365f756,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0e606d-84') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:46:43 user nova-compute[74131]:   <uuid>4ca71861-05ab-442e-a07b-e86480a930fe</uuid>
Oct 20 16:46:43 user nova-compute[74131]:   <name>instance-0000002e</name>
Oct 20 16:46:43 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:46:43 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:46:43 user nova-compute[74131]:   <metadata>
Oct 20 16:46:43 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:46:43 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:46:43 user nova-compute[74131]:       <nova:name>tempest-AttachVolumeTestJSON-server-2009212484</nova:name>
Oct 20 16:46:43 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:46:43</nova:creationTime>
Oct 20 16:46:43 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:46:43 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:46:43 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:46:43 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:46:43 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:46:43 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:46:43 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:46:43 user nova-compute[74131]:       <nova:owner>
Oct 20 16:46:43 user nova-compute[74131]:         <nova:user uuid="fea2a757da8e46dda15f3e996a94940f">tempest-AttachVolumeTestJSON-791392427-project-member</nova:user>
Oct 20 16:46:43 user nova-compute[74131]:         <nova:project uuid="7795f458a4c844238e9dece3464d4b69">tempest-AttachVolumeTestJSON-791392427</nova:project>
Oct 20 16:46:43 user nova-compute[74131]:       </nova:owner>
Oct 20 16:46:43 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:46:43 user nova-compute[74131]:       <nova:ports>
Oct 20 16:46:43 user nova-compute[74131]:         <nova:port uuid="0a0e606d-842a-409c-a7e4-c5b29365f756">
Oct 20 16:46:43 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 16:46:43 user nova-compute[74131]:         </nova:port>
Oct 20 16:46:43 user nova-compute[74131]:       </nova:ports>
Oct 20 16:46:43 user nova-compute[74131]:     </nova:instance>
Oct 20 16:46:43 user nova-compute[74131]:   </metadata>
Oct 20 16:46:43 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:46:43 user nova-compute[74131]:     <system>
Oct 20 16:46:43 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:46:43 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:46:43 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:46:43 user nova-compute[74131]:       <entry name="serial">4ca71861-05ab-442e-a07b-e86480a930fe</entry>
Oct 20 16:46:43 user nova-compute[74131]:       <entry name="uuid">4ca71861-05ab-442e-a07b-e86480a930fe</entry>
Oct 20 16:46:43 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:46:43 user nova-compute[74131]:     </system>
Oct 20 16:46:43 user nova-compute[74131]:   </sysinfo>
Oct 20 16:46:43 user nova-compute[74131]:   <os>
Oct 20 16:46:43 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:46:43 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:46:43 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:46:43 user nova-compute[74131]:   </os>
Oct 20 16:46:43 user nova-compute[74131]:   <features>
Oct 20 16:46:43 user nova-compute[74131]:     <acpi/>
Oct 20 16:46:43 user nova-compute[74131]:     <apic/>
Oct 20 16:46:43 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:46:43 user nova-compute[74131]:   </features>
Oct 20 16:46:43 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:46:43 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:46:43 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:46:43 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:46:43 user nova-compute[74131]:   </clock>
Oct 20 16:46:43 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:46:43 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:46:43 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:46:43 user nova-compute[74131]:   </cpu>
Oct 20 16:46:43 user nova-compute[74131]:   <devices>
Oct 20 16:46:43 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:46:43 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:46:43 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk"/>
Oct 20 16:46:43 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:46:43 user nova-compute[74131]:     </disk>
Oct 20 16:46:43 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:46:43 user nova-compute[74131]:       <mac address="fa:16:3e:8b:3e:8f"/>
Oct 20 16:46:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:46:43 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:46:43 user nova-compute[74131]:       <target dev="tap0a0e606d-84"/>
Oct 20 16:46:43 user nova-compute[74131]:     </interface>
Oct 20 16:46:43 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:46:43 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/console.log" append="off"/>
Oct 20 16:46:43 user nova-compute[74131]:     </serial>
Oct 20 16:46:43 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:46:43 user nova-compute[74131]:     <video>
Oct 20 16:46:43 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:46:43 user nova-compute[74131]:     </video>
Oct 20 16:46:43 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:46:43 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:46:43 user nova-compute[74131]:     </rng>
Oct 20 16:46:43 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:46:43 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:46:43 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:46:43 user nova-compute[74131]:     </memballoon>
Oct 20 16:46:43 user nova-compute[74131]:   </devices>
Oct 20 16:46:43 user nova-compute[74131]: </domain>
Oct 20 16:46:43 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2009212484',display_name='tempest-AttachVolumeTestJSON-server-2009212484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2009212484',id=46,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4MWOULKoqZJcWJUFv7FDUdpYhRCyAODTOTkqEUa3mtNdPIZqjOiaKSraIP1jYrp5RuNMQHvPbkuJcHjyXMGAgc1tbyS9wFLmRnBR279graZYOKFCGNhn0wmfFpHTtGWA==',key_name='tempest-keypair-1934026091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-wd2huwk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=4ca71861-05ab-442e-a07b-e86480a930fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3e:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a0e606d-842a-409c-a7e4-c5b29365f756,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0e606d-84') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG os_vif [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3e:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a0e606d-842a-409c-a7e4-c5b29365f756,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0e606d-84') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b1f32fa-7b8f-529a-a770-dca5af1beefb', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a0e606d-84, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a0e606d-84, col_values=(('qos', UUID('6b205d0d-4bf2-4405-a8ee-21b171fc59a3')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a0e606d-84, col_values=(('external_ids', {'iface-id': '0a0e606d-842a-409c-a7e4-c5b29365f756', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:3e:8f', 'vm-uuid': '4ca71861-05ab-442e-a07b-e86480a930fe'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:43 user nova-compute[74131]: INFO os_vif [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3e:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a0e606d-842a-409c-a7e4-c5b29365f756,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0e606d-84')
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No VIF found with MAC fa:16:3e:8b:3e:8f, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-de202a7a-c1f3-48eb-bf98-746f29688f59 req-0d2d554d-d28f-4a95-b23e-85e043349d7a service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de202a7a-c1f3-48eb-bf98-746f29688f59 req-0d2d554d-d28f-4a95-b23e-85e043349d7a service nova] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de202a7a-c1f3-48eb-bf98-746f29688f59 req-0d2d554d-d28f-4a95-b23e-85e043349d7a service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-de202a7a-c1f3-48eb-bf98-746f29688f59 req-0d2d554d-d28f-4a95-b23e-85e043349d7a service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-de202a7a-c1f3-48eb-bf98-746f29688f59 req-0d2d554d-d28f-4a95-b23e-85e043349d7a service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] No waiting events found dispatching network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:47 user nova-compute[74131]: WARNING nova.compute.manager [req-de202a7a-c1f3-48eb-bf98-746f29688f59 req-0d2d554d-d28f-4a95-b23e-85e043349d7a service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received unexpected event network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 for instance with vm_state building and task_state spawning.
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-changed-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Refreshing instance network info cache due to event network-changed-fb6f6be9-2cc1-4412-b6fc-31320ad56f81. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] Acquiring lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] Acquired lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Refreshing network info cache for port fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-b21692c2-3288-4d7f-a3fe-fe3d21e1e14d req-44190e8d-64ba-45c1-9b48-a99c2f4c126b service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b21692c2-3288-4d7f-a3fe-fe3d21e1e14d req-44190e8d-64ba-45c1-9b48-a99c2f4c126b service nova] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b21692c2-3288-4d7f-a3fe-fe3d21e1e14d req-44190e8d-64ba-45c1-9b48-a99c2f4c126b service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b21692c2-3288-4d7f-a3fe-fe3d21e1e14d req-44190e8d-64ba-45c1-9b48-a99c2f4c126b service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-b21692c2-3288-4d7f-a3fe-fe3d21e1e14d req-44190e8d-64ba-45c1-9b48-a99c2f4c126b service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] No waiting events found dispatching network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:47 user nova-compute[74131]: WARNING nova.compute.manager [req-b21692c2-3288-4d7f-a3fe-fe3d21e1e14d req-44190e8d-64ba-45c1-9b48-a99c2f4c126b service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received unexpected event network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 for instance with vm_state building and task_state spawning.
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:46:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:46:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=25.127838134765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "2ae75eb1-f460-4304-aebd-541775743e3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Instance spawned successfully.
Oct 20 16:46:47 user nova-compute[74131]: INFO nova.compute.manager [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Terminating instance
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updated VIF entry in instance network info cache for port 0a0e606d-842a-409c-a7e4-c5b29365f756. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updating instance_info_cache with network_info: [{"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aca5fe73-98df-4ab6-8b80-ae0e3f9f1521 req-3eefcc83-a2ae-4dc9-b6a2-c3f0b9de8484 service nova] Releasing lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:47 user nova-compute[74131]: INFO nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Took 6.19 seconds to spawn the instance on the hypervisor.
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 2ae75eb1-f460-4304-aebd-541775743e3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4ca71861-05ab-442e-a07b-e86480a930fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:47 user nova-compute[74131]: INFO nova.compute.manager [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Took 7.02 seconds to build instance.
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5078c262-be11-44c7-83d2-f1d16ab4811c tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:46:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.network.neutron [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updated VIF entry in instance network info cache for port fb6f6be9-2cc1-4412-b6fc-31320ad56f81. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.network.neutron [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating instance_info_cache with network_info: [{"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-615241bd-189b-4c9f-aa57-52f93038a44b req-13a8ff9e-af58-4f31-9bcb-749e06e68ba4 service nova] Releasing lock "refresh_cache-2ae75eb1-f460-4304-aebd-541775743e3f" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Instance destroyed successfully.
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lazy-loading 'resources' on Instance uuid 2ae75eb1-f460-4304-aebd-541775743e3f {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-746578784',display_name='tempest-TestVolumeBootPattern-server-746578784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-746578784',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiA7/8XbeQ6MnY+sc3D58CkfS6hsMLxEKUVHpddm2kh9uTJNasJIoyQmSrEW7+40W6IHLKtH7qYWBHykmYj+SMLi8Zo0eLC2WBTlb8fzCrUi+erqwBRNFjD99nlblfKPA==',key_name='tempest-TestVolumeBootPattern-807061264',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:41:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08267e8d79941d3a555dc3a51c58985',ramdisk_id='',reservation_id='r-ra34kpcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-978997028',owner_user_name='tempest-TestVolumeBootPattern-978997028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:41:59Z,user_data=None,user_id='6c0f3a5e9862491897ec87644c577ebf',uuid=2ae75eb1-f460-4304-aebd-541775743e3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converting VIF {"id": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "address": "fa:16:3e:c4:8c:c2", "network": {"id": "ac3b5285-5f1f-44d0-a248-25175a00c2ef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-442109834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08267e8d79941d3a555dc3a51c58985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f6be9-2c", "ovs_interfaceid": "fb6f6be9-2cc1-4412-b6fc-31320ad56f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:8c:c2,bridge_name='br-int',has_traffic_filtering=True,id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f6be9-2c') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_vif [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:8c:c2,bridge_name='br-int',has_traffic_filtering=True,id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f6be9-2c') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb6f6be9-2c, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2370868-6eec-4d02-a211-9208d5be90ae) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: INFO os_vif [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:8c:c2,bridge_name='br-int',has_traffic_filtering=True,id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81,network=Network(ac3b5285-5f1f-44d0-a248-25175a00c2ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f6be9-2c')
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZrqEhAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:46:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c040b-e7c9-4cf9-b0d8-3ff365a3b1f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:46:48 user nova-compute[74131]: No targets found.
Oct 20 16:46:48 user nova-compute[74131]: iSNS:
Oct 20 16:46:48 user nova-compute[74131]: No targets found.
Oct 20 16:46:48 user nova-compute[74131]: STATIC:
Oct 20 16:46:48 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31
Oct 20 16:46:48 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:46:48 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:46:48 user nova-compute[74131]: FIRMWARE:
Oct 20 16:46:48 user nova-compute[74131]: No targets found.
Oct 20 16:46:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:46:48 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:46:48 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde0ec72-3353-443f-851e-1229a480ac48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-unplugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-unplugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-unplugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:48 user nova-compute[74131]: WARNING nova.compute.manager [req-331bf45e-c052-475a-869f-d51146ac381a req-b8ac1e85-32a6-425c-b803-85bceb7456ee service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received unexpected event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with vm_state active and task_state deleting.
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f5f4bb-1a63-4d26-b300-c39f0c854e37]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:46:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 (non-flash)
Oct 20 16:46:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8773370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31'): ({'sdd'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Removing single pathed devices sdd {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f03b27-0a37-442f-aea6-3ee72b0dc910]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[506d0016-a844-4b73-a251-5a76d6964e80]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Flushing IO for device /dev/sdd {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c778de9a-24bf-4cf7-b8fc-ed5cf3b8e19f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cd2efc-4633-4e7f-bf2a-69314120f9be]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] SCSI volumes sdd have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO89ce2588-0036ff14dd9debe1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_89ce2588', '/dev/disk/by-id/scsi-23030333666663134') {{(pid=84843) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fa2fe6-0d32-4235-a7d1-c7367c4e9cb7]: (4, None) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1bfdb3-8de7-438f-8a35-15b9e3bf224e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7b5878-c34a-4caa-8b73-b6c4ec79b78c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260]
Oct 20 16:46:48 user nova-compute[74131]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31, portal: 172.16.0.220,3260] successful.
Oct 20 16:46:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd468416-0b4e-4d5f-97a7-71806199ac31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1441c5c-9133-4126-930d-837eb4c9b5eb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] <== disconnect_volume: return (372ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:46:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Deleting instance files /opt/stack/data/nova/instances/2ae75eb1-f460-4304-aebd-541775743e3f_del
Oct 20 16:46:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Deletion of /opt/stack/data/nova/instances/2ae75eb1-f460-4304-aebd-541775743e3f_del complete
Oct 20 16:46:48 user nova-compute[74131]: INFO nova.compute.manager [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:46:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:49 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:46:49 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Took 0.50 seconds to deallocate network for instance.
Oct 20 16:46:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-94df84a5-44a8-4b00-bdc7-c7b3ee5bb5aa req-3e02cc23-a63c-432e-8aa8-d6f814c568c2 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-deleted-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:49 user nova-compute[74131]: INFO nova.compute.manager [req-94df84a5-44a8-4b00-bdc7-c7b3ee5bb5aa req-3e02cc23-a63c-432e-8aa8-d6f814c568c2 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Neutron deleted interface fb6f6be9-2cc1-4412-b6fc-31320ad56f81; detaching it from the instance and deleting it from the info cache
Oct 20 16:46:49 user nova-compute[74131]: DEBUG nova.network.neutron [req-94df84a5-44a8-4b00-bdc7-c7b3ee5bb5aa req-3e02cc23-a63c-432e-8aa8-d6f814c568c2 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:46:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-94df84a5-44a8-4b00-bdc7-c7b3ee5bb5aa req-3e02cc23-a63c-432e-8aa8-d6f814c568c2 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Detach interface failed, port_id=fb6f6be9-2cc1-4412-b6fc-31320ad56f81, reason: Instance 2ae75eb1-f460-4304-aebd-541775743e3f could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:46:50 user nova-compute[74131]: INFO nova.compute.manager [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Took 0.85 seconds to detach 1 volumes for instance.
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:50 user nova-compute[74131]: WARNING nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received unexpected event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with vm_state deleted and task_state None.
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:50 user nova-compute[74131]: WARNING nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received unexpected event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with vm_state deleted and task_state None.
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-unplugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-unplugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:50 user nova-compute[74131]: WARNING nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received unexpected event network-vif-unplugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with vm_state deleted and task_state None.
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Acquiring lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] Lock "2ae75eb1-f460-4304-aebd-541775743e3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] No waiting events found dispatching network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:46:50 user nova-compute[74131]: WARNING nova.compute.manager [req-67590e6d-d928-47a0-a7aa-15f62352d2a3 req-80c65026-f988-4c70-9642-26ce8a06d5b8 service nova] [instance: 2ae75eb1-f460-4304-aebd-541775743e3f] Received unexpected event network-vif-plugged-fb6f6be9-2cc1-4412-b6fc-31320ad56f81 for instance with vm_state deleted and task_state None.
Oct 20 16:46:50 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Deleted allocations for instance 2ae75eb1-f460-4304-aebd-541775743e3f
Oct 20 16:46:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5a27edc5-61e1-4a28-a804-57332b294165 tempest-TestVolumeBootPattern-978997028 tempest-TestVolumeBootPattern-978997028-project-member] Lock "2ae75eb1-f460-4304-aebd-541775743e3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.059s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:46:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:46:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:15 user nova-compute[74131]: INFO nova.compute.manager [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Rescuing
Oct 20 16:47:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-85c5bcd4-690b-4b60-8d6a-6ce162ee85da req-81a22116-62e7-4fe7-bd02-8123489a0622 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-unplugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-85c5bcd4-690b-4b60-8d6a-6ce162ee85da req-81a22116-62e7-4fe7-bd02-8123489a0622 service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-85c5bcd4-690b-4b60-8d6a-6ce162ee85da req-81a22116-62e7-4fe7-bd02-8123489a0622 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-85c5bcd4-690b-4b60-8d6a-6ce162ee85da req-81a22116-62e7-4fe7-bd02-8123489a0622 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-85c5bcd4-690b-4b60-8d6a-6ce162ee85da req-81a22116-62e7-4fe7-bd02-8123489a0622 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-unplugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:47:15 user nova-compute[74131]: WARNING nova.compute.manager [req-85c5bcd4-690b-4b60-8d6a-6ce162ee85da req-81a22116-62e7-4fe7-bd02-8123489a0622 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received unexpected event network-vif-unplugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with vm_state active and task_state rescuing.
Oct 20 16:47:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance destroyed successfully.
Oct 20 16:47:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Attempting rescue
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74131) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:47:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Creating image(s)
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'trusted_certs' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue" returned: 0 in 0.054s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'migration_context' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.base [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<a32a162c-9a8f-4b69-95e0-425f75d234bf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Start _get_guest_xml network_info=[{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:49:b4:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'resources' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.base [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<a32a162c-9a8f-4b69-95e0-425f75d234bf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'numa_topology' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.base [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<a32a162c-9a8f-4b69-95e0-425f75d234bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:47:16 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:47:16 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'vcpu_model' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.base [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<a32a162c-9a8f-4b69-95e0-425f75d234bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851827302',display_name='tempest-ServerRescueNegativeTestJSON-server-1851827302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851827302',id=45,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-p459o8s1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:45:33Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=a32a162c-9a8f-4b69-95e0-425f75d234bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:49:b4:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:49:b4:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'pci_devices' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.objects.base [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<a32a162c-9a8f-4b69-95e0-425f75d234bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:47:16 user nova-compute[74131]:   <uuid>a32a162c-9a8f-4b69-95e0-425f75d234bf</uuid>
Oct 20 16:47:16 user nova-compute[74131]:   <name>instance-0000002d</name>
Oct 20 16:47:16 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:47:16 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:47:16 user nova-compute[74131]:   <metadata>
Oct 20 16:47:16 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:47:16 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:47:16 user nova-compute[74131]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1851827302</nova:name>
Oct 20 16:47:16 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:47:16</nova:creationTime>
Oct 20 16:47:16 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:47:16 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:47:16 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:47:16 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:47:16 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:47:16 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:47:16 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:47:16 user nova-compute[74131]:       <nova:owner>
Oct 20 16:47:16 user nova-compute[74131]:         <nova:user uuid="5bc5139a72784dc8b85c3a17b9ce722d">tempest-ServerRescueNegativeTestJSON-1760443836-project-member</nova:user>
Oct 20 16:47:16 user nova-compute[74131]:         <nova:project uuid="368249a7186c4968a3b8d8fa5fbd8737">tempest-ServerRescueNegativeTestJSON-1760443836</nova:project>
Oct 20 16:47:16 user nova-compute[74131]:       </nova:owner>
Oct 20 16:47:16 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:47:16 user nova-compute[74131]:       <nova:ports>
Oct 20 16:47:16 user nova-compute[74131]:         <nova:port uuid="8acbb837-c91e-4feb-a2f1-dd0db1c69dd6">
Oct 20 16:47:16 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 16:47:16 user nova-compute[74131]:         </nova:port>
Oct 20 16:47:16 user nova-compute[74131]:       </nova:ports>
Oct 20 16:47:16 user nova-compute[74131]:     </nova:instance>
Oct 20 16:47:16 user nova-compute[74131]:   </metadata>
Oct 20 16:47:16 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:47:16 user nova-compute[74131]:     <system>
Oct 20 16:47:16 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:47:16 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:47:16 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:47:16 user nova-compute[74131]:       <entry name="serial">a32a162c-9a8f-4b69-95e0-425f75d234bf</entry>
Oct 20 16:47:16 user nova-compute[74131]:       <entry name="uuid">a32a162c-9a8f-4b69-95e0-425f75d234bf</entry>
Oct 20 16:47:16 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:47:16 user nova-compute[74131]:     </system>
Oct 20 16:47:16 user nova-compute[74131]:   </sysinfo>
Oct 20 16:47:16 user nova-compute[74131]:   <os>
Oct 20 16:47:16 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:47:16 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:47:16 user nova-compute[74131]:   </os>
Oct 20 16:47:16 user nova-compute[74131]:   <features>
Oct 20 16:47:16 user nova-compute[74131]:     <acpi/>
Oct 20 16:47:16 user nova-compute[74131]:     <apic/>
Oct 20 16:47:16 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:47:16 user nova-compute[74131]:   </features>
Oct 20 16:47:16 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:47:16 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:47:16 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:47:16 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:47:16 user nova-compute[74131]:   </clock>
Oct 20 16:47:16 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:47:16 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:47:16 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:47:16 user nova-compute[74131]:   </cpu>
Oct 20 16:47:16 user nova-compute[74131]:   <devices>
Oct 20 16:47:16 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:47:16 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:47:16 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue"/>
Oct 20 16:47:16 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:47:16 user nova-compute[74131]:     </disk>
Oct 20 16:47:16 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:47:16 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:47:16 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk"/>
Oct 20 16:47:16 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:47:16 user nova-compute[74131]:     </disk>
Oct 20 16:47:16 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:47:16 user nova-compute[74131]:       <mac address="fa:16:3e:49:b4:2c"/>
Oct 20 16:47:16 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:47:16 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:47:16 user nova-compute[74131]:       <target dev="tap8acbb837-c9"/>
Oct 20 16:47:16 user nova-compute[74131]:     </interface>
Oct 20 16:47:16 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:47:16 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/console.log" append="off"/>
Oct 20 16:47:16 user nova-compute[74131]:     </serial>
Oct 20 16:47:16 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:47:16 user nova-compute[74131]:     <video>
Oct 20 16:47:16 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:47:16 user nova-compute[74131]:     </video>
Oct 20 16:47:16 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:47:16 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:47:16 user nova-compute[74131]:     </rng>
Oct 20 16:47:16 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:47:16 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:47:16 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:47:16 user nova-compute[74131]:     </memballoon>
Oct 20 16:47:16 user nova-compute[74131]:   </devices>
Oct 20 16:47:16 user nova-compute[74131]: </domain>
Oct 20 16:47:16 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:47:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance destroyed successfully.
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:47:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No VIF found with MAC fa:16:3e:49:b4:2c, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-d06f6feb-d549-4c07-9e96-7a56260a1514 req-6ea6c3d5-96ca-4569-a896-fcf8a56d9cbb service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d06f6feb-d549-4c07-9e96-7a56260a1514 req-6ea6c3d5-96ca-4569-a896-fcf8a56d9cbb service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d06f6feb-d549-4c07-9e96-7a56260a1514 req-6ea6c3d5-96ca-4569-a896-fcf8a56d9cbb service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d06f6feb-d549-4c07-9e96-7a56260a1514 req-6ea6c3d5-96ca-4569-a896-fcf8a56d9cbb service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-d06f6feb-d549-4c07-9e96-7a56260a1514 req-6ea6c3d5-96ca-4569-a896-fcf8a56d9cbb service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:47:18 user nova-compute[74131]: WARNING nova.compute.manager [req-d06f6feb-d549-4c07-9e96-7a56260a1514 req-6ea6c3d5-96ca-4569-a896-fcf8a56d9cbb service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received unexpected event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with vm_state active and task_state rescuing.
Oct 20 16:47:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:47:20 user nova-compute[74131]: WARNING nova.compute.manager [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received unexpected event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with vm_state active and task_state rescuing.
Oct 20 16:47:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG nova.compute.manager [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:47:20 user nova-compute[74131]: WARNING nova.compute.manager [req-ecdf3a04-2da9-4027-bfcc-246ab2c3904d req-f5475aac-be32-4b2b-90fb-b75330015758 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received unexpected event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with vm_state active and task_state rescuing.
Oct 20 16:47:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c4675ca7-e296-4303-8ce7-dac5a992606c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:47:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:32 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:47:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:42 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:47:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:47:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:47:42 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:47:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:47:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:47:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=25.086551666259766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4ca71861-05ab-442e-a07b-e86480a930fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:47:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:47:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:47:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:47:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:48:00 user nova-compute[74131]: INFO nova.compute.claims [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Claim successful on node user
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:48:00 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:48:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.policy [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79ecc014bff9436fa3a56b07eb000e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3242b8cff4e818350224d48bdc2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:48:01 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Creating image(s)
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "/opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "/opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk 1073741824" returned: 0 in 0.059s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Successfully created port: 05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.201s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Cannot resize image /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Ensure instance console log exists: /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Successfully updated port: 05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquired lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.compute.manager [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-changed-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.compute.manager [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Refreshing instance network info cache due to event network-changed-05a2c044-7023-496f-841f-90506a65389e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] Acquiring lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Updating instance_info_cache with network_info: [{"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Releasing lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Instance network_info: |[{"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] Acquired lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Refreshing network info cache for port 05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Start _get_guest_xml network_info=[{"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:48:02 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:48:02 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1056951755',display_name='tempest-VolumesSnapshotTestJSON-instance-1056951755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1056951755',id=47,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOAiorX5vtCnA4DkjBDQREDF4ursIAqI8CODb52oc00mRpq3wxO0gtPwsmmJ+Y5GeRvSp35jArE3we5kqCoea6JFG2vzjCeLg/5f8v4pcquftyZYCRqVKRvvF9g9TtI4A==',key_name='tempest-keypair-104850834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50c3242b8cff4e818350224d48bdc2b3',ramdisk_id='',reservation_id='r-90icatbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1859134084',owner_user_name='tempest-VolumesSnapshotTestJSON-1859134084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79ecc014bff9436fa3a56b07eb000e5b',uuid=9ce29a1a-d265-4072-9d56-e7baefff7ccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converting VIF {"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=05a2c044-7023-496f-841f-90506a65389e,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a2c044-70') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ce29a1a-d265-4072-9d56-e7baefff7ccf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:48:02 user nova-compute[74131]:   <uuid>9ce29a1a-d265-4072-9d56-e7baefff7ccf</uuid>
Oct 20 16:48:02 user nova-compute[74131]:   <name>instance-0000002f</name>
Oct 20 16:48:02 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:48:02 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:48:02 user nova-compute[74131]:   <metadata>
Oct 20 16:48:02 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:48:02 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:48:02 user nova-compute[74131]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1056951755</nova:name>
Oct 20 16:48:02 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:48:02</nova:creationTime>
Oct 20 16:48:02 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:48:02 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:48:02 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:48:02 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:48:02 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:48:02 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:48:02 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:48:02 user nova-compute[74131]:       <nova:owner>
Oct 20 16:48:02 user nova-compute[74131]:         <nova:user uuid="79ecc014bff9436fa3a56b07eb000e5b">tempest-VolumesSnapshotTestJSON-1859134084-project-member</nova:user>
Oct 20 16:48:02 user nova-compute[74131]:         <nova:project uuid="50c3242b8cff4e818350224d48bdc2b3">tempest-VolumesSnapshotTestJSON-1859134084</nova:project>
Oct 20 16:48:02 user nova-compute[74131]:       </nova:owner>
Oct 20 16:48:02 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:48:02 user nova-compute[74131]:       <nova:ports>
Oct 20 16:48:02 user nova-compute[74131]:         <nova:port uuid="05a2c044-7023-496f-841f-90506a65389e">
Oct 20 16:48:02 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 16:48:02 user nova-compute[74131]:         </nova:port>
Oct 20 16:48:02 user nova-compute[74131]:       </nova:ports>
Oct 20 16:48:02 user nova-compute[74131]:     </nova:instance>
Oct 20 16:48:02 user nova-compute[74131]:   </metadata>
Oct 20 16:48:02 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:48:02 user nova-compute[74131]:     <system>
Oct 20 16:48:02 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:48:02 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:48:02 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:48:02 user nova-compute[74131]:       <entry name="serial">9ce29a1a-d265-4072-9d56-e7baefff7ccf</entry>
Oct 20 16:48:02 user nova-compute[74131]:       <entry name="uuid">9ce29a1a-d265-4072-9d56-e7baefff7ccf</entry>
Oct 20 16:48:02 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:48:02 user nova-compute[74131]:     </system>
Oct 20 16:48:02 user nova-compute[74131]:   </sysinfo>
Oct 20 16:48:02 user nova-compute[74131]:   <os>
Oct 20 16:48:02 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:48:02 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:48:02 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:48:02 user nova-compute[74131]:   </os>
Oct 20 16:48:02 user nova-compute[74131]:   <features>
Oct 20 16:48:02 user nova-compute[74131]:     <acpi/>
Oct 20 16:48:02 user nova-compute[74131]:     <apic/>
Oct 20 16:48:02 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:48:02 user nova-compute[74131]:   </features>
Oct 20 16:48:02 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:48:02 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:48:02 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:48:02 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:48:02 user nova-compute[74131]:   </clock>
Oct 20 16:48:02 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:48:02 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:48:02 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:48:02 user nova-compute[74131]:   </cpu>
Oct 20 16:48:02 user nova-compute[74131]:   <devices>
Oct 20 16:48:02 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:48:02 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:48:02 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk"/>
Oct 20 16:48:02 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:48:02 user nova-compute[74131]:     </disk>
Oct 20 16:48:02 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:48:02 user nova-compute[74131]:       <mac address="fa:16:3e:07:3f:8f"/>
Oct 20 16:48:02 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:48:02 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:48:02 user nova-compute[74131]:       <target dev="tap05a2c044-70"/>
Oct 20 16:48:02 user nova-compute[74131]:     </interface>
Oct 20 16:48:02 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:48:02 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/console.log" append="off"/>
Oct 20 16:48:02 user nova-compute[74131]:     </serial>
Oct 20 16:48:02 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:48:02 user nova-compute[74131]:     <video>
Oct 20 16:48:02 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:48:02 user nova-compute[74131]:     </video>
Oct 20 16:48:02 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:48:02 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:48:02 user nova-compute[74131]:     </rng>
Oct 20 16:48:02 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:48:02 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:48:02 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:48:02 user nova-compute[74131]:     </memballoon>
Oct 20 16:48:02 user nova-compute[74131]:   </devices>
Oct 20 16:48:02 user nova-compute[74131]: </domain>
Oct 20 16:48:02 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1056951755',display_name='tempest-VolumesSnapshotTestJSON-instance-1056951755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1056951755',id=47,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOAiorX5vtCnA4DkjBDQREDF4ursIAqI8CODb52oc00mRpq3wxO0gtPwsmmJ+Y5GeRvSp35jArE3we5kqCoea6JFG2vzjCeLg/5f8v4pcquftyZYCRqVKRvvF9g9TtI4A==',key_name='tempest-keypair-104850834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50c3242b8cff4e818350224d48bdc2b3',ramdisk_id='',reservation_id='r-90icatbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1859134084',owner_user_name='tempest-VolumesSnapshotTestJSON-1859134084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79ecc014bff9436fa3a56b07eb000e5b',uuid=9ce29a1a-d265-4072-9d56-e7baefff7ccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converting VIF {"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=05a2c044-7023-496f-841f-90506a65389e,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a2c044-70') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG os_vif [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=05a2c044-7023-496f-841f-90506a65389e,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a2c044-70') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a5d3656-f59d-5b8a-a572-27f4b546c74b', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05a2c044-70, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05a2c044-70, col_values=(('qos', UUID('01509c7a-dd11-4fd1-9e55-a1d7c9a948ed')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05a2c044-70, col_values=(('external_ids', {'iface-id': '05a2c044-7023-496f-841f-90506a65389e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:3f:8f', 'vm-uuid': '9ce29a1a-d265-4072-9d56-e7baefff7ccf'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:02 user nova-compute[74131]: INFO os_vif [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=05a2c044-7023-496f-841f-90506a65389e,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a2c044-70')
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:48:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No VIF found with MAC fa:16:3e:07:3f:8f, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:48:03 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Updated VIF entry in instance network info cache for port 05a2c044-7023-496f-841f-90506a65389e. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:48:03 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Updating instance_info_cache with network_info: [{"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:48:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e552238-dcb6-4f10-88a7-9d482acc786c req-9deae00a-495c-4490-abe1-0c6eab7b1440 service nova] Releasing lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-81a312c1-2ed3-4034-8611-0ceab691ccbf req-a7fba322-0f13-4320-ae2f-e91c09469c2f service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-81a312c1-2ed3-4034-8611-0ceab691ccbf req-a7fba322-0f13-4320-ae2f-e91c09469c2f service nova] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-81a312c1-2ed3-4034-8611-0ceab691ccbf req-a7fba322-0f13-4320-ae2f-e91c09469c2f service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-81a312c1-2ed3-4034-8611-0ceab691ccbf req-a7fba322-0f13-4320-ae2f-e91c09469c2f service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-81a312c1-2ed3-4034-8611-0ceab691ccbf req-a7fba322-0f13-4320-ae2f-e91c09469c2f service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] No waiting events found dispatching network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:48:04 user nova-compute[74131]: WARNING nova.compute.manager [req-81a312c1-2ed3-4034-8611-0ceab691ccbf req-a7fba322-0f13-4320-ae2f-e91c09469c2f service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received unexpected event network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e for instance with vm_state building and task_state spawning.
Oct 20 16:48:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:48:06 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Instance spawned successfully.
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:48:06 user nova-compute[74131]: INFO nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:48:06 user nova-compute[74131]: INFO nova.compute.manager [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Took 6.13 seconds to build instance.
Oct 20 16:48:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0491b84f-5439-4f76-ad05-b29a8bb15bcd tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.253s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-110f34af-f32a-476b-87e9-e6c53da17764 req-52c36fad-fdc4-4419-ab4b-177f64b1316e service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-110f34af-f32a-476b-87e9-e6c53da17764 req-52c36fad-fdc4-4419-ab4b-177f64b1316e service nova] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-110f34af-f32a-476b-87e9-e6c53da17764 req-52c36fad-fdc4-4419-ab4b-177f64b1316e service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-110f34af-f32a-476b-87e9-e6c53da17764 req-52c36fad-fdc4-4419-ab4b-177f64b1316e service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-110f34af-f32a-476b-87e9-e6c53da17764 req-52c36fad-fdc4-4419-ab4b-177f64b1316e service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] No waiting events found dispatching network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:48:06 user nova-compute[74131]: WARNING nova.compute.manager [req-110f34af-f32a-476b-87e9-e6c53da17764 req-52c36fad-fdc4-4419-ab4b-177f64b1316e service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received unexpected event network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e for instance with vm_state active and task_state None.
Oct 20 16:48:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:48:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:48:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:48:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:48:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:48:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:30 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-changed-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:48:31 user nova-compute[74131]: DEBUG nova.compute.manager [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Refreshing instance network info cache due to event network-changed-0a0e606d-842a-409c-a7e4-c5b29365f756. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:48:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] Acquiring lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:48:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] Acquired lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:48:31 user nova-compute[74131]: DEBUG nova.network.neutron [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Refreshing network info cache for port 0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:48:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updated VIF entry in instance network info cache for port 0a0e606d-842a-409c-a7e4-c5b29365f756. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:48:32 user nova-compute[74131]: DEBUG nova.network.neutron [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updating instance_info_cache with network_info: [{"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:48:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1235340f-597b-4927-b873-a6a92766d007 req-abfb312e-b948-4b84-be86-9c9c253e4272 service nova] Releasing lock "refresh_cache-4ca71861-05ab-442e-a07b-e86480a930fe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:48:32 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:32 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:32 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG nova.objects.instance [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:36 user nova-compute[74131]: INFO nova.compute.manager [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Attaching volume 75d3f196-26da-49e9-981b-4e70522d8682 to /dev/vdb
Oct 20 16:48:36 user nova-compute[74131]: DEBUG os_brick.utils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0e7cd-2349-4e00-9e07-34c5c4d22fd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e05393-787b-4dd0-86fe-804e775175fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[05abe554-7e05-46d6-9ef5-edd2c49b57ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bd4100-460e-49b2-bd47-2d32c5efd14e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:48:36 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:48:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc6aab2-f3b4-4a8d-8d07-9aa532491183]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG os_brick.utils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:48:36 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updating existing volume attachment record: 2794fa06-1c36-4ab2-9e35-da75917243e1 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:48:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:43 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:44 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:48:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8502MB free_disk=25.045974731445312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4ca71861-05ab-442e-a07b-e86480a930fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:48:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:48:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:48 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:48:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:48:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:48:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:48:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgPzDMBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:48:53 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:48:53 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:48:53 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[43470bba-9d1d-40bd-b045-f5c2f37eb858]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:48:53 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14f8dae-595a-4bf7-8508-16fe3437aef2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682] added
Oct 20 16:48:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[50138f5a-7a7b-43c6-aa54-ddf0a5e48dfb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77c2dd0-fc9f-430e-9d17-1c8ebf90838c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgPzDMBK {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgPzDMBK" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[589e1e63-57b9-44a7-80a3-ceca635fb075]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgPzDMBK'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b24d11-0bd2-441c-bcbd-d29c564718f1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2392416c-47da-48e8-9e95-e8753e5a47f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:48:53 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:48:53 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:48:53 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 16:48:53 user nova-compute[74131]: 
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4db3c9-2e55-492f-a5c2-fde24add9377]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260]
Oct 20 16:48:53 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260] successful.
Oct 20 16:48:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[db23e6ca-4f26-49fd-a752-7890c934b6a5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c11cb5-b4d6-4f89-b1e9-bf18062aac48]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:48:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:48:53 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cced7-9a93-40a9-b5fd-888f9b958ec2]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:48:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgPzDMBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23761626433323963', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761626433323963', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG nova.objects.instance [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:48:54 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:48:54 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:48:54 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:48:54 user nova-compute[74131]:   <serial>75d3f196-26da-49e9-981b-4e70522d8682</serial>
Oct 20 16:48:54 user nova-compute[74131]: </disk>
Oct 20 16:48:54 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No VIF found with MAC fa:16:3e:8b:3e:8f, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:48:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99d7a78c-3727-4472-ba40-0d21177aea01 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.316s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:48:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG nova.objects.instance [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:01 user nova-compute[74131]: INFO nova.compute.manager [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Attaching volume 2225e62a-954e-4338-bce6-e1a333f9ca4a to /dev/vdc
Oct 20 16:49:01 user nova-compute[74131]: DEBUG os_brick.utils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[660541df-e6e9-4874-a8fd-32488369d22f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd45bbc-863e-472a-ac9c-7f1bfe6709ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c605aa9-fdf8-4a3d-8ca0-ee8af2ab2915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba1dccc-6803-419e-8048-f57fd08118db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:49:02 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:49:02 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83f7708-d9e4-4cde-9f41-bed5871ae3bf]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG os_brick.utils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updating existing volume attachment record: 1ec6e218-24ba-4217-9651-41066b96708e {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:49:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUhBCJMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:49:18 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:49:18 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:49:18 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1e8e2-fb29-4cee-b0d1-07c85092c911]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:49:18 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2d486-2530-4e1f-babe-38c8e7d26ae6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a] added
Oct 20 16:49:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b11dcfb-cc3c-4ee6-83ab-a3d80ced26a4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[33941c91-a36e-4b52-b3fb-5b55fc4a98ff]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUhBCJMu {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUhBCJMu" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf8aa67-9c55-4f9e-9d1b-56156b92b742]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUhBCJMu'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e0a60d-cc7a-45dc-a356-0a81c127feb1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f3c618-7e78-4c96-b5df-50ae80be55d3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:49:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:49:18 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:49:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --login" returned: 0 in 1.071s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd79ca24-5c7e-46d0-a87b-9efe28883dc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260]
Oct 20 16:49:19 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260] successful.
Oct 20 16:49:19 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9057302-2262-4a8c-b347-2200c217136c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5297da17-9a4f-4e4f-ae86-09edb7331268]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:49:19 user nova-compute[74131]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)
Oct 20 16:49:19 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:49:19 user nova-compute[74131]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)
Oct 20 16:49:19 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.294s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760a83f-1fc5-40fe-84a3-9a6444290909]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:49:19 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUhBCJMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:49:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.327s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:49:20 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== connect_volume: return (2329ms) {'type': 'block', 'scsi_wwn': '26365623139643237', 'path': '/dev/sdc'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:49:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365623139643237', 'path': '/dev/sdc'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:49:20 user nova-compute[74131]: DEBUG nova.objects.instance [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:49:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:49:20 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:49:20 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:49:20 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:49:20 user nova-compute[74131]:   <serial>2225e62a-954e-4338-bce6-e1a333f9ca4a</serial>
Oct 20 16:49:20 user nova-compute[74131]: </disk>
Oct 20 16:49:20 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:49:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:49:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:49:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:49:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] No VIF found with MAC fa:16:3e:8b:3e:8f, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:49:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-029514f5-7206-408e-9c31-b94dcbeb3d36 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.599s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:22 user nova-compute[74131]: INFO nova.compute.manager [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Detaching volume 75d3f196-26da-49e9-981b-4e70522d8682
Oct 20 16:49:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:22 user nova-compute[74131]: INFO nova.virt.block_device [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Attempting to driver detach volume 75d3f196-26da-49e9-981b-4e70522d8682 from mountpoint /dev/vdb
Oct 20 16:49:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Attempting to detach device vdb from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:49:22 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:49:22 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:49:22 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:49:22 user nova-compute[74131]:   <serial>75d3f196-26da-49e9-981b-4e70522d8682</serial>
Oct 20 16:49:22 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:49:22 user nova-compute[74131]: </disk>
Oct 20 16:49:22 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:49:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully detached device vdb from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the persistent domain config.
Oct 20 16:49:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:49:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:49:22 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:49:22 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:49:22 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:49:22 user nova-compute[74131]:   <serial>75d3f196-26da-49e9-981b-4e70522d8682</serial>
Oct 20 16:49:22 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:49:22 user nova-compute[74131]: </disk>
Oct 20 16:49:22 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:49:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:49:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:32 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:34 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:38 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:49:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:43 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ca71861-05ab-442e-a07b-e86480a930fe is timed out.
Oct 20 16:49:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully detached device vdb from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the live domain config.
Oct 20 16:49:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgPzDMBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:49:43 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7341120-d2e8-49af-8da8-a6c3d90b9a04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:49:43 user nova-compute[74131]: No targets found.
Oct 20 16:49:43 user nova-compute[74131]: iSNS:
Oct 20 16:49:43 user nova-compute[74131]: No targets found.
Oct 20 16:49:43 user nova-compute[74131]: STATIC:
Oct 20 16:49:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682
Oct 20 16:49:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:49:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:49:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a
Oct 20 16:49:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:49:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:49:43 user nova-compute[74131]: FIRMWARE:
Oct 20 16:49:43 user nova-compute[74131]: No targets found.
Oct 20 16:49:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:49:43 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:49:43 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a54468-cf97-4789-9488-508439e1599e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39746543-881d-4266-b9d9-ac31afe1efa8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:49:43 user nova-compute[74131]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)
Oct 20 16:49:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 (non-flash)
Oct 20 16:49:43 user nova-compute[74131]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)
Oct 20 16:49:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8773e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d9ec34-9431-4501-9463-6a16dd945c56]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34ce964-84d9-463d-aec3-0d406c1eb194]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c9f96f-f44c-4c88-a376-20a5c36d5d9d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc019a3-a91c-4467-83cb-2e995f5def65]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0e02de-3130-4a8a-83af-4434ee736f4f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5092d580-b580-44d9-9e13-f9c9d28bf67a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260]
Oct 20 16:49:43 user nova-compute[74131]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682, portal: 172.16.0.220,3260] successful.
Oct 20 16:49:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d3f196-26da-49e9-981b-4e70522d8682 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb52f3b-35dc-4c6d-a045-6ee9cbf75cab]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== disconnect_volume: return (305ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:49:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG nova.objects.instance [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-671545c4-8ec5-4f00-b35a-65b4ba348a5f tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.890s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:49:44 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:45 user nova-compute[74131]: INFO nova.compute.manager [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Detaching volume 2225e62a-954e-4338-bce6-e1a333f9ca4a
Oct 20 16:49:45 user nova-compute[74131]: INFO nova.virt.block_device [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Attempting to driver detach volume 2225e62a-954e-4338-bce6-e1a333f9ca4a from mountpoint /dev/vdc
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Attempting to detach device vdc from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:49:45 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:49:45 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:49:45 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:49:45 user nova-compute[74131]:   <serial>2225e62a-954e-4338-bce6-e1a333f9ca4a</serial>
Oct 20 16:49:45 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 16:49:45 user nova-compute[74131]: </disk>
Oct 20 16:49:45 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:49:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully detached device vdc from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the persistent domain config.
Oct 20 16:49:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:49:45 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:49:45 user nova-compute[74131]:   <source dev="/dev/sdc"/>
Oct 20 16:49:45 user nova-compute[74131]:   <target dev="vdc" bus="virtio"/>
Oct 20 16:49:45 user nova-compute[74131]:   <serial>2225e62a-954e-4338-bce6-e1a333f9ca4a</serial>
Oct 20 16:49:45 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 16:49:45 user nova-compute[74131]: </disk>
Oct 20 16:49:45 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:49:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=25.043621063232422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 4ca71861-05ab-442e-a07b-e86480a930fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:49:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:49:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-changed-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Refreshing instance network info cache due to event network-changed-05a2c044-7023-496f-841f-90506a65389e. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] Acquiring lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] Acquired lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG nova.network.neutron [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Refreshing network info cache for port 05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG nova.network.neutron [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Updated VIF entry in instance network info cache for port 05a2c044-7023-496f-841f-90506a65389e. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG nova.network.neutron [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Updating instance_info_cache with network_info: [{"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:49:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c3644650-2fcb-4603-a081-2274977522c2 req-8c0b6ed7-a9e3-4175-9efc-b99bf82004f2 service nova] Releasing lock "refresh_cache-9ce29a1a-d265-4072-9d56-e7baefff7ccf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'flavor' on Instance uuid 9ce29a1a-d265-4072-9d56-e7baefff7ccf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:49:52 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Ignoring supplied device name: /dev/vdb
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:49:52 user nova-compute[74131]: INFO nova.compute.manager [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Attaching volume 98e57fbe-c116-445f-888b-ec756563572f to /dev/vdb
Oct 20 16:49:52 user nova-compute[74131]: DEBUG os_brick.utils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd95eb-7b4f-4813-9603-616a1e8746f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bd2b31-b3c9-44ed-986d-b56b827fb251]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ecd0b-152b-4093-8e35-10c36887e9e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8588f586-bfd8-4ee5-aec2-5fb0d8913d90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:49:52 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:49:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef65e70-b247-4e74-ada4-3fca6c8ac637]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG os_brick.utils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Updating existing volume attachment record: 56245824-3dbb-4fae-aad3-ebe51f8f468e {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:49:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:49:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:49:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:06 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4ca71861-05ab-442e-a07b-e86480a930fe is timed out.
Oct 20 16:50:06 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully detached device vdc from instance 4ca71861-05ab-442e-a07b-e86480a930fe from the live domain config.
Oct 20 16:50:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUhBCJMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:50:06 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e932a5-f22f-4d5d-a85e-f3e13734e7fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:50:06 user nova-compute[74131]: No targets found.
Oct 20 16:50:06 user nova-compute[74131]: iSNS:
Oct 20 16:50:06 user nova-compute[74131]: No targets found.
Oct 20 16:50:06 user nova-compute[74131]: STATIC:
Oct 20 16:50:06 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a
Oct 20 16:50:06 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:50:06 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:50:06 user nova-compute[74131]: FIRMWARE:
Oct 20 16:50:06 user nova-compute[74131]: No targets found.
Oct 20 16:50:06 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:50:06 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:50:06 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cfa707-ab50-4b37-a704-4f9af9722abc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f7e5c-91fa-45f7-b902-3ab2b7869730]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)
Oct 20 16:50:06 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a (non-flash)
Oct 20 16:50:06 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8653eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a'): ({'sdc'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Removing single pathed devices sdc {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[20390e33-6fec-4796-a501-934b7f5f4825]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df15e5b-8ea6-4f1b-a16b-388531b5ef24]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Flushing IO for device /dev/sdc {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd163cfe-212b-4337-b2ae-67e8a72cb911]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[462a19f0-a6c5-4b2b-928d-054a0725db3c]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] SCSI volumes sdc have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c7d6c-aa57-4ac8-ab64-a1c5fa7651ba]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b47efc6-6a29-444d-b030-c8e331d88be4]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260]
Oct 20 16:50:06 user nova-compute[74131]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a, portal: 172.16.0.220,3260] successful.
Oct 20 16:50:06 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2225e62a-954e-4338-bce6-e1a333f9ca4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd852b6-128b-4ddb-a922-ed9e3a775c86]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] <== disconnect_volume: return (290ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:50:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:50:07 user nova-compute[74131]: DEBUG nova.objects.instance [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'flavor' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-44834e0c-8bb8-4f1f-8aaa-1bda6a89f896 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.768s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:50:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:50:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:50:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:50:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:08 user nova-compute[74131]: INFO nova.compute.manager [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Terminating instance
Oct 20 16:50:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-74df87b3-fb31-495e-a6a3-00872c21fa03 req-d8309c4c-b532-4c5e-93f8-0dd545252f63 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-vif-unplugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-74df87b3-fb31-495e-a6a3-00872c21fa03 req-d8309c4c-b532-4c5e-93f8-0dd545252f63 service nova] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-74df87b3-fb31-495e-a6a3-00872c21fa03 req-d8309c4c-b532-4c5e-93f8-0dd545252f63 service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-74df87b3-fb31-495e-a6a3-00872c21fa03 req-d8309c4c-b532-4c5e-93f8-0dd545252f63 service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-74df87b3-fb31-495e-a6a3-00872c21fa03 req-d8309c4c-b532-4c5e-93f8-0dd545252f63 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] No waiting events found dispatching network-vif-unplugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:50:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-74df87b3-fb31-495e-a6a3-00872c21fa03 req-d8309c4c-b532-4c5e-93f8-0dd545252f63 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-vif-unplugged-0a0e606d-842a-409c-a7e4-c5b29365f756 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJzDgaHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:50:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:50:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:50:09 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b78df2-6973-4fcc-8d1d-d05bf733da17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:50:09 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbc0ee6-f52c-4e78-897a-a0d139405de8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f] added
Oct 20 16:50:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa280f3c-38ab-4fcf-a463-931fb70c80a8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb62e187-4dbf-40b3-84f5-20f9e2ff427c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJzDgaHP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJzDgaHP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb38b5e-de8f-4c4f-975b-1e3d98fe329e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CJzDgaHP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[283713a2-2b76-4d55-9336-6da34896d69b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Instance destroyed successfully.
Oct 20 16:50:09 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lazy-loading 'resources' on Instance uuid 4ca71861-05ab-442e-a07b-e86480a930fe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b134eea9-bade-443a-8695-c9fc8a005338]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:50:09 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:50:09 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:50:09 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 16:50:09 user nova-compute[74131]: 
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2009212484',display_name='tempest-AttachVolumeTestJSON-server-2009212484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2009212484',id=46,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4MWOULKoqZJcWJUFv7FDUdpYhRCyAODTOTkqEUa3mtNdPIZqjOiaKSraIP1jYrp5RuNMQHvPbkuJcHjyXMGAgc1tbyS9wFLmRnBR279graZYOKFCGNhn0wmfFpHTtGWA==',key_name='tempest-keypair-1934026091',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7795f458a4c844238e9dece3464d4b69',ramdisk_id='',reservation_id='r-wd2huwk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-791392427',owner_user_name='tempest-AttachVolumeTestJSON-791392427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea2a757da8e46dda15f3e996a94940f',uuid=4ca71861-05ab-442e-a07b-e86480a930fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converting VIF {"id": "0a0e606d-842a-409c-a7e4-c5b29365f756", "address": "fa:16:3e:8b:3e:8f", "network": {"id": "4843d85e-2efb-4a0a-be5a-09436a4a3d55", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2056829049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7795f458a4c844238e9dece3464d4b69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0e606d-84", "ovs_interfaceid": "0a0e606d-842a-409c-a7e4-c5b29365f756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:3e:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a0e606d-842a-409c-a7e4-c5b29365f756,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0e606d-84') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_vif [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:3e:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a0e606d-842a-409c-a7e4-c5b29365f756,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0e606d-84') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a0e606d-84, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b205d0d-4bf2-4405-a8ee-21b171fc59a3) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:50:09 user nova-compute[74131]: INFO os_vif [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:3e:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a0e606d-842a-409c-a7e4-c5b29365f756,network=Network(4843d85e-2efb-4a0a-be5a-09436a4a3d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0e606d-84')
Oct 20 16:50:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Deleting instance files /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe_del
Oct 20 16:50:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Deletion of /opt/stack/data/nova/instances/4ca71861-05ab-442e-a07b-e86480a930fe_del complete
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b978229-bb5e-4cf0-b1cd-c68d6699fe7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260]
Oct 20 16:50:09 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260] successful.
Oct 20 16:50:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff164d-aa6f-4c63-9eb0-6001ce06d03e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: INFO nova.compute.manager [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8616d70-3ed0-4a67-aaa8-41cfbf2bc94a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f (non-flash)
Oct 20 16:50:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f (non-flash)
Oct 20 16:50:09 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4333e3a5-1379-458a-b7aa-1881e0ab8459]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:50:09 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:50:10 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Took 0.77 seconds to deallocate network for instance.
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-16c3bafd-2fd2-4677-a904-bc5795fa6590 req-26abed9e-26bb-4452-8f33-a5d2beb6ce43 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-vif-deleted-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:50:10 user nova-compute[74131]: INFO nova.compute.manager [req-16c3bafd-2fd2-4677-a904-bc5795fa6590 req-26abed9e-26bb-4452-8f33-a5d2beb6ce43 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Neutron deleted interface 0a0e606d-842a-409c-a7e4-c5b29365f756; detaching it from the instance and deleting it from the info cache
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.network.neutron [req-16c3bafd-2fd2-4677-a904-bc5795fa6590 req-26abed9e-26bb-4452-8f33-a5d2beb6ce43 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-16c3bafd-2fd2-4677-a904-bc5795fa6590 req-26abed9e-26bb-4452-8f33-a5d2beb6ce43 service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Detach interface failed, port_id=0a0e606d-842a-409c-a7e4-c5b29365f756, reason: Instance 4ca71861-05ab-442e-a07b-e86480a930fe could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJzDgaHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23038313233306334', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038313233306334', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'flavor' on Instance uuid 9ce29a1a-d265-4072-9d56-e7baefff7ccf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:50:10 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:50:10 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:50:10 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:50:10 user nova-compute[74131]:   <serial>98e57fbe-c116-445f-888b-ec756563572f</serial>
Oct 20 16:50:10 user nova-compute[74131]: </disk>
Oct 20 16:50:10 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:50:10 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Deleted allocations for instance 4ca71861-05ab-442e-a07b-e86480a930fe
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6696bac9-4e9f-4586-8547-6db3418da2a3 tempest-AttachVolumeTestJSON-791392427 tempest-AttachVolumeTestJSON-791392427-project-member] Lock "4ca71861-05ab-442e-a07b-e86480a930fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No VIF found with MAC fa:16:3e:07:3f:8f, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-a9c2fe84-a05c-4dab-b3fb-cc18d2519ffb req-a073d01a-90bb-4ce6-912c-16308b9e583b service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received event network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9c2fe84-a05c-4dab-b3fb-cc18d2519ffb req-a073d01a-90bb-4ce6-912c-16308b9e583b service nova] Acquiring lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9c2fe84-a05c-4dab-b3fb-cc18d2519ffb req-a073d01a-90bb-4ce6-912c-16308b9e583b service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a9c2fe84-a05c-4dab-b3fb-cc18d2519ffb req-a073d01a-90bb-4ce6-912c-16308b9e583b service nova] Lock "4ca71861-05ab-442e-a07b-e86480a930fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-a9c2fe84-a05c-4dab-b3fb-cc18d2519ffb req-a073d01a-90bb-4ce6-912c-16308b9e583b service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] No waiting events found dispatching network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:50:10 user nova-compute[74131]: WARNING nova.compute.manager [req-a9c2fe84-a05c-4dab-b3fb-cc18d2519ffb req-a073d01a-90bb-4ce6-912c-16308b9e583b service nova] [instance: 4ca71861-05ab-442e-a07b-e86480a930fe] Received unexpected event network-vif-plugged-0a0e606d-842a-409c-a7e4-c5b29365f756 for instance with vm_state deleted and task_state None.
Oct 20 16:50:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7aea5277-f5c2-4d4b-b66d-efbab9cb1929 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.360s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:12 user nova-compute[74131]: INFO nova.compute.manager [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Rescuing
Oct 20 16:50:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:50:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:50:12 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:50:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:50:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:50:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-c663ad8d-870f-4d93-b4fc-45cd306b40cd req-76c038a7-9c6e-4842-b6a8-5cb68fc15dce service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c663ad8d-870f-4d93-b4fc-45cd306b40cd req-76c038a7-9c6e-4842-b6a8-5cb68fc15dce service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c663ad8d-870f-4d93-b4fc-45cd306b40cd req-76c038a7-9c6e-4842-b6a8-5cb68fc15dce service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c663ad8d-870f-4d93-b4fc-45cd306b40cd req-76c038a7-9c6e-4842-b6a8-5cb68fc15dce service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-c663ad8d-870f-4d93-b4fc-45cd306b40cd req-76c038a7-9c6e-4842-b6a8-5cb68fc15dce service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:50:14 user nova-compute[74131]: WARNING nova.compute.manager [req-c663ad8d-870f-4d93-b4fc-45cd306b40cd req-76c038a7-9c6e-4842-b6a8-5cb68fc15dce service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state active and task_state rescuing.
Oct 20 16:50:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance destroyed successfully.
Oct 20 16:50:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Attempting rescue
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74131) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:50:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Creating image(s)
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'trusted_certs' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue" returned: 0 in 0.051s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'migration_context' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<72c13338-0ecf-4383-a9db-b316bda13601> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Start _get_guest_xml network_info=[{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:fa:8a:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'resources' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<72c13338-0ecf-4383-a9db-b316bda13601> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'numa_topology' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<72c13338-0ecf-4383-a9db-b316bda13601> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:50:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:50:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'vcpu_model' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<72c13338-0ecf-4383-a9db-b316bda13601> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-903614781',display_name='tempest-ServerRescueNegativeTestJSON-server-903614781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-903614781',id=44,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-wvb9jdcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:45:33Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=72c13338-0ecf-4383-a9db-b316bda13601,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:fa:8a:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:fa:8a:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<72c13338-0ecf-4383-a9db-b316bda13601> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:50:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:50:14 user nova-compute[74131]:   <uuid>72c13338-0ecf-4383-a9db-b316bda13601</uuid>
Oct 20 16:50:14 user nova-compute[74131]:   <name>instance-0000002c</name>
Oct 20 16:50:14 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:50:14 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:50:14 user nova-compute[74131]:   <metadata>
Oct 20 16:50:14 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:50:14 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:50:14 user nova-compute[74131]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-903614781</nova:name>
Oct 20 16:50:14 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:50:14</nova:creationTime>
Oct 20 16:50:14 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:50:14 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:50:14 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:50:14 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:50:14 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:50:14 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:50:14 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:50:14 user nova-compute[74131]:       <nova:owner>
Oct 20 16:50:14 user nova-compute[74131]:         <nova:user uuid="5bc5139a72784dc8b85c3a17b9ce722d">tempest-ServerRescueNegativeTestJSON-1760443836-project-member</nova:user>
Oct 20 16:50:14 user nova-compute[74131]:         <nova:project uuid="368249a7186c4968a3b8d8fa5fbd8737">tempest-ServerRescueNegativeTestJSON-1760443836</nova:project>
Oct 20 16:50:14 user nova-compute[74131]:       </nova:owner>
Oct 20 16:50:14 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:50:14 user nova-compute[74131]:       <nova:ports>
Oct 20 16:50:14 user nova-compute[74131]:         <nova:port uuid="b203dd7e-1fcd-4c66-a7c0-69079cb17f1f">
Oct 20 16:50:14 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 16:50:14 user nova-compute[74131]:         </nova:port>
Oct 20 16:50:14 user nova-compute[74131]:       </nova:ports>
Oct 20 16:50:14 user nova-compute[74131]:     </nova:instance>
Oct 20 16:50:14 user nova-compute[74131]:   </metadata>
Oct 20 16:50:14 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:50:14 user nova-compute[74131]:     <system>
Oct 20 16:50:14 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:50:14 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:50:14 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:50:14 user nova-compute[74131]:       <entry name="serial">72c13338-0ecf-4383-a9db-b316bda13601</entry>
Oct 20 16:50:14 user nova-compute[74131]:       <entry name="uuid">72c13338-0ecf-4383-a9db-b316bda13601</entry>
Oct 20 16:50:14 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:50:14 user nova-compute[74131]:     </system>
Oct 20 16:50:14 user nova-compute[74131]:   </sysinfo>
Oct 20 16:50:14 user nova-compute[74131]:   <os>
Oct 20 16:50:14 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:50:14 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:50:14 user nova-compute[74131]:   </os>
Oct 20 16:50:14 user nova-compute[74131]:   <features>
Oct 20 16:50:14 user nova-compute[74131]:     <acpi/>
Oct 20 16:50:14 user nova-compute[74131]:     <apic/>
Oct 20 16:50:14 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:50:14 user nova-compute[74131]:   </features>
Oct 20 16:50:14 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:50:14 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:50:14 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:50:14 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:50:14 user nova-compute[74131]:   </clock>
Oct 20 16:50:14 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:50:14 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:50:14 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:50:14 user nova-compute[74131]:   </cpu>
Oct 20 16:50:14 user nova-compute[74131]:   <devices>
Oct 20 16:50:14 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:50:14 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:50:14 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue"/>
Oct 20 16:50:14 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:50:14 user nova-compute[74131]:     </disk>
Oct 20 16:50:14 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:50:14 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:50:14 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk"/>
Oct 20 16:50:14 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:50:14 user nova-compute[74131]:     </disk>
Oct 20 16:50:14 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:50:14 user nova-compute[74131]:       <mac address="fa:16:3e:fa:8a:ae"/>
Oct 20 16:50:14 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:50:14 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:50:14 user nova-compute[74131]:       <target dev="tapb203dd7e-1f"/>
Oct 20 16:50:14 user nova-compute[74131]:     </interface>
Oct 20 16:50:14 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:50:14 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/console.log" append="off"/>
Oct 20 16:50:14 user nova-compute[74131]:     </serial>
Oct 20 16:50:14 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:50:14 user nova-compute[74131]:     <video>
Oct 20 16:50:14 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:50:14 user nova-compute[74131]:     </video>
Oct 20 16:50:14 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:50:14 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:50:14 user nova-compute[74131]:     </rng>
Oct 20 16:50:14 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:50:14 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:50:14 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:50:14 user nova-compute[74131]:     </memballoon>
Oct 20 16:50:14 user nova-compute[74131]:   </devices>
Oct 20 16:50:14 user nova-compute[74131]: </domain>
Oct 20 16:50:14 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:50:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance destroyed successfully.
Oct 20 16:50:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:50:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:50:15 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No VIF found with MAC fa:16:3e:fa:8a:ae, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-8d9e9aa8-ea53-4da6-bd61-e0f6a38ce18a req-0c47405f-fb9d-4098-abb3-46e90cbd2a7f service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8d9e9aa8-ea53-4da6-bd61-e0f6a38ce18a req-0c47405f-fb9d-4098-abb3-46e90cbd2a7f service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8d9e9aa8-ea53-4da6-bd61-e0f6a38ce18a req-0c47405f-fb9d-4098-abb3-46e90cbd2a7f service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8d9e9aa8-ea53-4da6-bd61-e0f6a38ce18a req-0c47405f-fb9d-4098-abb3-46e90cbd2a7f service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-8d9e9aa8-ea53-4da6-bd61-e0f6a38ce18a req-0c47405f-fb9d-4098-abb3-46e90cbd2a7f service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:50:16 user nova-compute[74131]: WARNING nova.compute.manager [req-8d9e9aa8-ea53-4da6-bd61-e0f6a38ce18a req-0c47405f-fb9d-4098-abb3-46e90cbd2a7f service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state active and task_state rescuing.
Oct 20 16:50:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:50:18 user nova-compute[74131]: WARNING nova.compute.manager [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state active and task_state rescuing.
Oct 20 16:50:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:50:18 user nova-compute[74131]: WARNING nova.compute.manager [req-1c865d7c-3be7-4b45-9f2d-7977bfadb387 req-3b6fe155-9b31-4ca9-a635-eab93a61a9a7 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state active and task_state rescuing.
Oct 20 16:50:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-0805f714-eaaf-4163-aab6-2ae14576a78c tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:50:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:31 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:50:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:50:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:50:34 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:34 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:50:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:50:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:50:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:50:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:50:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:50:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:50:48 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:50:48 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.06060791015625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:50:48 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:50:49 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:50:49 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:50:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:50:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:50:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:50:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:51:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:51:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:51:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:51:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:51:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:10 user nova-compute[74131]: INFO nova.compute.manager [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Detaching volume 98e57fbe-c116-445f-888b-ec756563572f
Oct 20 16:51:10 user nova-compute[74131]: INFO nova.virt.block_device [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Attempting to driver detach volume 98e57fbe-c116-445f-888b-ec756563572f from mountpoint /dev/vdb
Oct 20 16:51:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Attempting to detach device vdb from instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:51:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:51:10 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:51:10 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:51:10 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:51:10 user nova-compute[74131]:   <serial>98e57fbe-c116-445f-888b-ec756563572f</serial>
Oct 20 16:51:10 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:51:10 user nova-compute[74131]: </disk>
Oct 20 16:51:10 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:51:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully detached device vdb from instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf from the persistent domain config.
Oct 20 16:51:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:51:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:51:10 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:51:10 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:51:10 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:51:10 user nova-compute[74131]:   <serial>98e57fbe-c116-445f-888b-ec756563572f</serial>
Oct 20 16:51:10 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:51:10 user nova-compute[74131]: </disk>
Oct 20 16:51:10 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:51:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:51:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:51:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:51:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:51:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:51:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:51:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:30 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf is timed out.
Oct 20 16:51:30 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully detached device vdb from instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf from the live domain config.
Oct 20 16:51:30 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJzDgaHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:51:30 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa880f-528c-4225-83ef-ee2b3906aad4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:51:30 user nova-compute[74131]: No targets found.
Oct 20 16:51:30 user nova-compute[74131]: iSNS:
Oct 20 16:51:30 user nova-compute[74131]: No targets found.
Oct 20 16:51:30 user nova-compute[74131]: STATIC:
Oct 20 16:51:30 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f
Oct 20 16:51:30 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:51:30 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:51:30 user nova-compute[74131]: FIRMWARE:
Oct 20 16:51:30 user nova-compute[74131]: No targets found.
Oct 20 16:51:30 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:51:30 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:51:30 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2159d712-b6df-4a3f-8eee-0588dc561749]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b681a-df58-402e-80c9-fc9749a179f8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f (non-flash)
Oct 20 16:51:30 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f (non-flash)
Oct 20 16:51:30 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8508d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96366d4-500a-45e0-8b41-96d5299746b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6516686-31ed-4e10-9372-219e26f2045e]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d72dd38-19d6-4cb8-8e7c-479a81439f77]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a450f72-0f09-4fd7-8505-1a3fd2599a10]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab19519-477e-45f6-9624-4ae30aa98431]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:51:30 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec73a081-fe47-47d8-a4f9-c6bdc6117ec4]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260]
Oct 20 16:51:31 user nova-compute[74131]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f, portal: 172.16.0.220,3260] successful.
Oct 20 16:51:31 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b88bfdd-c20b-4c67-97f1-6eb7c569c487]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== disconnect_volume: return (288ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG nova.objects.instance [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'flavor' on Instance uuid 9ce29a1a-d265-4072-9d56-e7baefff7ccf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-db8fa15b-7d59-4ab9-bd4e-0cbedab363a0 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.537s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:31 user nova-compute[74131]: INFO nova.compute.manager [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Terminating instance
Oct 20 16:51:31 user nova-compute[74131]: DEBUG nova.compute.manager [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-83caca1e-d659-4207-bc78-e930ee0db4fc req-5a6ffc6a-5567-4fc7-a848-797867b46bbf service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-vif-unplugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-83caca1e-d659-4207-bc78-e930ee0db4fc req-5a6ffc6a-5567-4fc7-a848-797867b46bbf service nova] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-83caca1e-d659-4207-bc78-e930ee0db4fc req-5a6ffc6a-5567-4fc7-a848-797867b46bbf service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-83caca1e-d659-4207-bc78-e930ee0db4fc req-5a6ffc6a-5567-4fc7-a848-797867b46bbf service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-83caca1e-d659-4207-bc78-e930ee0db4fc req-5a6ffc6a-5567-4fc7-a848-797867b46bbf service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] No waiting events found dispatching network-vif-unplugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-83caca1e-d659-4207-bc78-e930ee0db4fc req-5a6ffc6a-5567-4fc7-a848-797867b46bbf service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-vif-unplugged-05a2c044-7023-496f-841f-90506a65389e for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:51:32 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Instance destroyed successfully.
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'resources' on Instance uuid 9ce29a1a-d265-4072-9d56-e7baefff7ccf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1056951755',display_name='tempest-VolumesSnapshotTestJSON-instance-1056951755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1056951755',id=47,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOAiorX5vtCnA4DkjBDQREDF4ursIAqI8CODb52oc00mRpq3wxO0gtPwsmmJ+Y5GeRvSp35jArE3we5kqCoea6JFG2vzjCeLg/5f8v4pcquftyZYCRqVKRvvF9g9TtI4A==',key_name='tempest-keypair-104850834',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:48:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50c3242b8cff4e818350224d48bdc2b3',ramdisk_id='',reservation_id='r-90icatbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1859134084',owner_user_name='tempest-VolumesSnapshotTestJSON-1859134084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:48:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79ecc014bff9436fa3a56b07eb000e5b',uuid=9ce29a1a-d265-4072-9d56-e7baefff7ccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converting VIF {"id": "05a2c044-7023-496f-841f-90506a65389e", "address": "fa:16:3e:07:3f:8f", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a2c044-70", "ovs_interfaceid": "05a2c044-7023-496f-841f-90506a65389e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=05a2c044-7023-496f-841f-90506a65389e,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a2c044-70') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG os_vif [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=05a2c044-7023-496f-841f-90506a65389e,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a2c044-70') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05a2c044-70, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01509c7a-dd11-4fd1-9e55-a1d7c9a948ed) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:32 user nova-compute[74131]: INFO os_vif [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=05a2c044-7023-496f-841f-90506a65389e,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a2c044-70')
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:98e57fbe-c116-445f-888b-ec756563572f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJzDgaHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:51:32 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:51:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2bc330d8-4ca0-4177-9fc1-0d54c0196e10]: Unexpected error while running command.
Oct 20 16:51:32 user nova-compute[74131]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:51:32 user nova-compute[74131]: Exit code: 21
Oct 20 16:51:32 user nova-compute[74131]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:51:32 user nova-compute[74131]: Stderr: '' {{(pid=84843) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 20 16:51:32 user nova-compute[74131]: Traceback (most recent call last):
Oct 20 16:51:32 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 20 16:51:32 user nova-compute[74131]:     ret = func(*f_args, **f_kwargs)
Oct 20 16:51:32 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 20 16:51:32 user nova-compute[74131]:     return func(*args, **kwargs)
Oct 20 16:51:32 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 20 16:51:32 user nova-compute[74131]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 20 16:51:32 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 20 16:51:32 user nova-compute[74131]:     return putils.execute(on_execute=on_execute,
Oct 20 16:51:32 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 20 16:51:32 user nova-compute[74131]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 20 16:51:32 user nova-compute[74131]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 16:51:32 user nova-compute[74131]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:51:32 user nova-compute[74131]: Exit code: 21
Oct 20 16:51:32 user nova-compute[74131]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:51:32 user nova-compute[74131]: Stderr: ''
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc330d8-4ca0-4177-9fc1-0d54c0196e10]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 16:51:32 user nova-compute[74131]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:51:32 user nova-compute[74131]: Exit code: 21
Oct 20 16:51:32 user nova-compute[74131]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:51:32 user nova-compute[74131]: Stderr: ''
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 20 16:51:32 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 16:51:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74131) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== disconnect_volume: return (65ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:51:32 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Deleting instance files /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf_del
Oct 20 16:51:32 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Deletion of /opt/stack/data/nova/instances/9ce29a1a-d265-4072-9d56-e7baefff7ccf_del complete
Oct 20 16:51:32 user nova-compute[74131]: INFO nova.compute.manager [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 20 16:51:32 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:51:32 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:51:33 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:51:33 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Took 0.72 seconds to deallocate network for instance.
Oct 20 16:51:33 user nova-compute[74131]: WARNING nova.volume.cinder [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Attachment 56245824-3dbb-4fae-aad3-ebe51f8f468e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 56245824-3dbb-4fae-aad3-ebe51f8f468e. (HTTP 404) (Request-ID: req-d838047e-3608-47d2-a909-9df48913b99b)
Oct 20 16:51:33 user nova-compute[74131]: INFO nova.compute.manager [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 16:51:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:33 user nova-compute[74131]: DEBUG nova.compute.manager [req-3a6f27ed-3a9a-4399-9ad9-23b11501956b req-f3a18f51-dddf-41e2-8178-b28b2c04fb98 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-vif-deleted-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:51:33 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:51:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:33 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:51:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:33 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Deleted allocations for instance 9ce29a1a-d265-4072-9d56-e7baefff7ccf
Oct 20 16:51:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a119dc96-5e66-4a85-8ace-46fffc9051d2 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-7ff4df8c-7fc1-499d-8735-1441a531d670 req-35ca83a6-280c-4f65-b969-0cf70315f234 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received event network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:51:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7ff4df8c-7fc1-499d-8735-1441a531d670 req-35ca83a6-280c-4f65-b969-0cf70315f234 service nova] Acquiring lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7ff4df8c-7fc1-499d-8735-1441a531d670 req-35ca83a6-280c-4f65-b969-0cf70315f234 service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7ff4df8c-7fc1-499d-8735-1441a531d670 req-35ca83a6-280c-4f65-b969-0cf70315f234 service nova] Lock "9ce29a1a-d265-4072-9d56-e7baefff7ccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-7ff4df8c-7fc1-499d-8735-1441a531d670 req-35ca83a6-280c-4f65-b969-0cf70315f234 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] No waiting events found dispatching network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:51:34 user nova-compute[74131]: WARNING nova.compute.manager [req-7ff4df8c-7fc1-499d-8735-1441a531d670 req-35ca83a6-280c-4f65-b969-0cf70315f234 service nova] [instance: 9ce29a1a-d265-4072-9d56-e7baefff7ccf] Received unexpected event network-vif-plugged-05a2c044-7023-496f-841f-90506a65389e for instance with vm_state deleted and task_state None.
Oct 20 16:51:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:51:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:51:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:46 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:51:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.08612060546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:51:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:51:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:51:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:51:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:04 user nova-compute[74131]: INFO nova.compute.manager [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Unrescuing
Oct 20 16:52:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:52:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:52:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:52:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:52:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:52:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'flavor' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:52:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-a2ba9114-dcb9-4be7-88e2-b0fad6610457 req-7b4aecda-3757-4fbc-b726-b8ecaa173f0a service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a2ba9114-dcb9-4be7-88e2-b0fad6610457 req-7b4aecda-3757-4fbc-b726-b8ecaa173f0a service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a2ba9114-dcb9-4be7-88e2-b0fad6610457 req-7b4aecda-3757-4fbc-b726-b8ecaa173f0a service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a2ba9114-dcb9-4be7-88e2-b0fad6610457 req-7b4aecda-3757-4fbc-b726-b8ecaa173f0a service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-a2ba9114-dcb9-4be7-88e2-b0fad6610457 req-7b4aecda-3757-4fbc-b726-b8ecaa173f0a service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:52:05 user nova-compute[74131]: WARNING nova.compute.manager [req-a2ba9114-dcb9-4be7-88e2-b0fad6610457 req-7b4aecda-3757-4fbc-b726-b8ecaa173f0a service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance destroyed successfully.
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:52:07 user nova-compute[74131]: WARNING nova.compute.manager [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:52:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:52:07 user nova-compute[74131]: WARNING nova.compute.manager [req-5065bab5-82f9-4b45-ac6a-4cf0476141d2 req-43a294ac-e050-4d4c-8c66-db35fa9ce4a0 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:52:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-c17f1722-640c-4a1c-9f10-4399ca55c55a tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:52:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-ccc3247f-8e08-486c-ab99-b87cae788605 req-ab954587-1bbb-4c3f-9992-4de7d8ffe937 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:52:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ccc3247f-8e08-486c-ab99-b87cae788605 req-ab954587-1bbb-4c3f-9992-4de7d8ffe937 service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ccc3247f-8e08-486c-ab99-b87cae788605 req-ab954587-1bbb-4c3f-9992-4de7d8ffe937 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-ccc3247f-8e08-486c-ab99-b87cae788605 req-ab954587-1bbb-4c3f-9992-4de7d8ffe937 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-ccc3247f-8e08-486c-ab99-b87cae788605 req-ab954587-1bbb-4c3f-9992-4de7d8ffe937 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:52:09 user nova-compute[74131]: WARNING nova.compute.manager [req-ccc3247f-8e08-486c-ab99-b87cae788605 req-ab954587-1bbb-4c3f-9992-4de7d8ffe937 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state active and task_state None.
Oct 20 16:52:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:52:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:52:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:52:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:52:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:52:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:37 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:52:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:52:44 user nova-compute[74131]: INFO nova.compute.claims [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Claim successful on node user
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:52:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:52:44 user nova-compute[74131]: DEBUG nova.policy [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79ecc014bff9436fa3a56b07eb000e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c3242b8cff4e818350224d48bdc2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:52:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Creating image(s)
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "/opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "/opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "/opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.195s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.202s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG nova.network.neutron [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Successfully created port: eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk 1073741824" returned: 0 in 0.055s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Cannot resize image /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Ensure instance console log exists: /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Successfully updated port: eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquired lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-changed-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Refreshing instance network info cache due to event network-changed-eba08665-f7a3-4860-a670-ac09557f7b17. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] Acquiring lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Updating instance_info_cache with network_info: [{"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Releasing lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Instance network_info: |[{"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] Acquired lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Refreshing network info cache for port eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Start _get_guest_xml network_info=[{"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:52:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:52:46 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1061073045',display_name='tempest-VolumesSnapshotTestJSON-instance-1061073045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1061073045',id=48,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0DLgr2Vgip2D8SPrISpPZV5vFlifjRx1rkQCprV9Oxfa0mDJifkRk/bQUhSkMpjPqKEOy3Jd19IyQl4W9jEk2ZyQLH4ER+rWeHLGXwUBRBdrwfIqUdrFL9drIOuSVk8g==',key_name='tempest-keypair-236013654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50c3242b8cff4e818350224d48bdc2b3',ramdisk_id='',reservation_id='r-7f5tran1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1859134084',owner_user_name='tempest-VolumesSnapshotTestJSON-1859134084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79ecc014bff9436fa3a56b07eb000e5b',uuid=d14f1277-c033-4cae-ad33-b8df0e5b5689,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converting VIF {"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=eba08665-f7a3-4860-a670-ac09557f7b17,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba08665-f7') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'pci_devices' on Instance uuid d14f1277-c033-4cae-ad33-b8df0e5b5689 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:52:46 user nova-compute[74131]:   <uuid>d14f1277-c033-4cae-ad33-b8df0e5b5689</uuid>
Oct 20 16:52:46 user nova-compute[74131]:   <name>instance-00000030</name>
Oct 20 16:52:46 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:52:46 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:52:46 user nova-compute[74131]:   <metadata>
Oct 20 16:52:46 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:52:46 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:52:46 user nova-compute[74131]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1061073045</nova:name>
Oct 20 16:52:46 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:52:46</nova:creationTime>
Oct 20 16:52:46 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:52:46 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:52:46 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:52:46 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:52:46 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:52:46 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:52:46 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:52:46 user nova-compute[74131]:       <nova:owner>
Oct 20 16:52:46 user nova-compute[74131]:         <nova:user uuid="79ecc014bff9436fa3a56b07eb000e5b">tempest-VolumesSnapshotTestJSON-1859134084-project-member</nova:user>
Oct 20 16:52:46 user nova-compute[74131]:         <nova:project uuid="50c3242b8cff4e818350224d48bdc2b3">tempest-VolumesSnapshotTestJSON-1859134084</nova:project>
Oct 20 16:52:46 user nova-compute[74131]:       </nova:owner>
Oct 20 16:52:46 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:52:46 user nova-compute[74131]:       <nova:ports>
Oct 20 16:52:46 user nova-compute[74131]:         <nova:port uuid="eba08665-f7a3-4860-a670-ac09557f7b17">
Oct 20 16:52:46 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 16:52:46 user nova-compute[74131]:         </nova:port>
Oct 20 16:52:46 user nova-compute[74131]:       </nova:ports>
Oct 20 16:52:46 user nova-compute[74131]:     </nova:instance>
Oct 20 16:52:46 user nova-compute[74131]:   </metadata>
Oct 20 16:52:46 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:52:46 user nova-compute[74131]:     <system>
Oct 20 16:52:46 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:52:46 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:52:46 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:52:46 user nova-compute[74131]:       <entry name="serial">d14f1277-c033-4cae-ad33-b8df0e5b5689</entry>
Oct 20 16:52:46 user nova-compute[74131]:       <entry name="uuid">d14f1277-c033-4cae-ad33-b8df0e5b5689</entry>
Oct 20 16:52:46 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:52:46 user nova-compute[74131]:     </system>
Oct 20 16:52:46 user nova-compute[74131]:   </sysinfo>
Oct 20 16:52:46 user nova-compute[74131]:   <os>
Oct 20 16:52:46 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:52:46 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:52:46 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:52:46 user nova-compute[74131]:   </os>
Oct 20 16:52:46 user nova-compute[74131]:   <features>
Oct 20 16:52:46 user nova-compute[74131]:     <acpi/>
Oct 20 16:52:46 user nova-compute[74131]:     <apic/>
Oct 20 16:52:46 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:52:46 user nova-compute[74131]:   </features>
Oct 20 16:52:46 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:52:46 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:52:46 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:52:46 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:52:46 user nova-compute[74131]:   </clock>
Oct 20 16:52:46 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:52:46 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:52:46 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:52:46 user nova-compute[74131]:   </cpu>
Oct 20 16:52:46 user nova-compute[74131]:   <devices>
Oct 20 16:52:46 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:52:46 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:52:46 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk"/>
Oct 20 16:52:46 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:52:46 user nova-compute[74131]:     </disk>
Oct 20 16:52:46 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:52:46 user nova-compute[74131]:       <mac address="fa:16:3e:94:d8:e7"/>
Oct 20 16:52:46 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:52:46 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:52:46 user nova-compute[74131]:       <target dev="tapeba08665-f7"/>
Oct 20 16:52:46 user nova-compute[74131]:     </interface>
Oct 20 16:52:46 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:52:46 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/console.log" append="off"/>
Oct 20 16:52:46 user nova-compute[74131]:     </serial>
Oct 20 16:52:46 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:52:46 user nova-compute[74131]:     <video>
Oct 20 16:52:46 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:52:46 user nova-compute[74131]:     </video>
Oct 20 16:52:46 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:52:46 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:52:46 user nova-compute[74131]:     </rng>
Oct 20 16:52:46 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:52:46 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:52:46 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:52:46 user nova-compute[74131]:     </memballoon>
Oct 20 16:52:46 user nova-compute[74131]:   </devices>
Oct 20 16:52:46 user nova-compute[74131]: </domain>
Oct 20 16:52:46 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1061073045',display_name='tempest-VolumesSnapshotTestJSON-instance-1061073045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1061073045',id=48,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0DLgr2Vgip2D8SPrISpPZV5vFlifjRx1rkQCprV9Oxfa0mDJifkRk/bQUhSkMpjPqKEOy3Jd19IyQl4W9jEk2ZyQLH4ER+rWeHLGXwUBRBdrwfIqUdrFL9drIOuSVk8g==',key_name='tempest-keypair-236013654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50c3242b8cff4e818350224d48bdc2b3',ramdisk_id='',reservation_id='r-7f5tran1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1859134084',owner_user_name='tempest-VolumesSnapshotTestJSON-1859134084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79ecc014bff9436fa3a56b07eb000e5b',uuid=d14f1277-c033-4cae-ad33-b8df0e5b5689,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converting VIF {"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=eba08665-f7a3-4860-a670-ac09557f7b17,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba08665-f7') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG os_vif [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=eba08665-f7a3-4860-a670-ac09557f7b17,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba08665-f7') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '201408b9-8f09-52d7-b06b-532096c8eb89', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeba08665-f7, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeba08665-f7, col_values=(('qos', UUID('dcf84171-c7e0-4e95-a110-a8c18f3ef0a8')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeba08665-f7, col_values=(('external_ids', {'iface-id': 'eba08665-f7a3-4860-a670-ac09557f7b17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:d8:e7', 'vm-uuid': 'd14f1277-c033-4cae-ad33-b8df0e5b5689'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:46 user nova-compute[74131]: INFO os_vif [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=eba08665-f7a3-4860-a670-ac09557f7b17,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba08665-f7')
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Skipping network cache update for instance because it is Building. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No VIF found with MAC fa:16:3e:94:d8:e7, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Updated VIF entry in instance network info cache for port eba08665-f7a3-4860-a670-ac09557f7b17. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG nova.network.neutron [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Updating instance_info_cache with network_info: [{"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:52:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d074b42-67ef-48a1-8c81-c56a1fd85819 req-c1a0accb-83db-4797-aaa5-f94573198f8e service nova] Releasing lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:47 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-c2a7f428-f7f5-40cb-a9c8-e2b4997ef013 req-52b45e66-cd2c-463c-8c3e-d65081237a51 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c2a7f428-f7f5-40cb-a9c8-e2b4997ef013 req-52b45e66-cd2c-463c-8c3e-d65081237a51 service nova] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c2a7f428-f7f5-40cb-a9c8-e2b4997ef013 req-52b45e66-cd2c-463c-8c3e-d65081237a51 service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c2a7f428-f7f5-40cb-a9c8-e2b4997ef013 req-52b45e66-cd2c-463c-8c3e-d65081237a51 service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-c2a7f428-f7f5-40cb-a9c8-e2b4997ef013 req-52b45e66-cd2c-463c-8c3e-d65081237a51 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] No waiting events found dispatching network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:52:48 user nova-compute[74131]: WARNING nova.compute.manager [req-c2a7f428-f7f5-40cb-a9c8-e2b4997ef013 req-52b45e66-cd2c-463c-8c3e-d65081237a51 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received unexpected event network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 for instance with vm_state building and task_state spawning.
Oct 20 16:52:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-9df61eb3-9c98-4cf1-88c4-7f585a4464a1 req-09c83b2a-c219-4be1-95f1-73b1b22ee92b service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9df61eb3-9c98-4cf1-88c4-7f585a4464a1 req-09c83b2a-c219-4be1-95f1-73b1b22ee92b service nova] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9df61eb3-9c98-4cf1-88c4-7f585a4464a1 req-09c83b2a-c219-4be1-95f1-73b1b22ee92b service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9df61eb3-9c98-4cf1-88c4-7f585a4464a1 req-09c83b2a-c219-4be1-95f1-73b1b22ee92b service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-9df61eb3-9c98-4cf1-88c4-7f585a4464a1 req-09c83b2a-c219-4be1-95f1-73b1b22ee92b service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] No waiting events found dispatching network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:52:50 user nova-compute[74131]: WARNING nova.compute.manager [req-9df61eb3-9c98-4cf1-88c4-7f585a4464a1 req-09c83b2a-c219-4be1-95f1-73b1b22ee92b service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received unexpected event network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 for instance with vm_state building and task_state spawning.
Oct 20 16:52:50 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:52:50 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=25.074901580810547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:52:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Instance spawned successfully.
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:52:50 user nova-compute[74131]: INFO nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Took 5.64 seconds to spawn the instance on the hypervisor.
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d14f1277-c033-4cae-ad33-b8df0e5b5689 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:52:50 user nova-compute[74131]: INFO nova.compute.manager [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Took 6.33 seconds to build instance.
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-df9863b2-f2bc-4e3d-b707-8fa3cc99bf81 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.439s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:52:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:52:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:52:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:53:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:53:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:53:35 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:36 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:53:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:53:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:53:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:53:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:53:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:53:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:53:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:53:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:53:47 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:53:48 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:53:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:53:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:53:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:53:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:53:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:53:49 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:53:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:51 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:53:51 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=25.045269012451172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d14f1277-c033-4cae-ad33-b8df0e5b5689 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:53:51 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:53:52 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:53:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:53:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:53:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:53:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:53:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:53:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:53:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:53:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:54:03 user nova-compute[74131]: INFO nova.compute.claims [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Claim successful on node user
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:54:03 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.policy [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bc5139a72784dc8b85c3a17b9ce722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368249a7186c4968a3b8d8fa5fbd8737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:54:03 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Creating image(s)
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk 1073741824" returned: 0 in 0.058s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Successfully created port: 4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Cannot resize image /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Ensure instance console log exists: /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Successfully updated port: 4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:54:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing instance network info cache due to event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.neutron [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance network_info: |[{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.neutron [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Start _get_guest_xml network_info=[{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:54:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:54:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1614270774',display_name='tempest-ServerRescueNegativeTestJSON-server-1614270774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1614270774',id=49,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/EGBllymBtG8XiDGo9+JNNczOkzoT8MnSRFsQrp3oWPdHU3Je2iDE0WXNhvjXBVYl1fj/v+VUL3iR1hGxpov6hrjoVPk216oirtcvlKw1TVIOSleZD8M+FFDpg3gOgGQ==',key_name='tempest-keypair-1248974718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-8lxivsi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=d0e5fd5a-c4c6-4e4b-9a84-0634074dad85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.objects.instance [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'pci_devices' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:54:05 user nova-compute[74131]:   <uuid>d0e5fd5a-c4c6-4e4b-9a84-0634074dad85</uuid>
Oct 20 16:54:05 user nova-compute[74131]:   <name>instance-00000031</name>
Oct 20 16:54:05 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:54:05 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:54:05 user nova-compute[74131]:   <metadata>
Oct 20 16:54:05 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:54:05 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:54:05 user nova-compute[74131]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1614270774</nova:name>
Oct 20 16:54:05 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:54:05</nova:creationTime>
Oct 20 16:54:05 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:54:05 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:54:05 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:54:05 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:54:05 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:54:05 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:54:05 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:54:05 user nova-compute[74131]:       <nova:owner>
Oct 20 16:54:05 user nova-compute[74131]:         <nova:user uuid="5bc5139a72784dc8b85c3a17b9ce722d">tempest-ServerRescueNegativeTestJSON-1760443836-project-member</nova:user>
Oct 20 16:54:05 user nova-compute[74131]:         <nova:project uuid="368249a7186c4968a3b8d8fa5fbd8737">tempest-ServerRescueNegativeTestJSON-1760443836</nova:project>
Oct 20 16:54:05 user nova-compute[74131]:       </nova:owner>
Oct 20 16:54:05 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:54:05 user nova-compute[74131]:       <nova:ports>
Oct 20 16:54:05 user nova-compute[74131]:         <nova:port uuid="4ea24282-5f57-4c96-855f-5f6625a5c9be">
Oct 20 16:54:05 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:54:05 user nova-compute[74131]:         </nova:port>
Oct 20 16:54:05 user nova-compute[74131]:       </nova:ports>
Oct 20 16:54:05 user nova-compute[74131]:     </nova:instance>
Oct 20 16:54:05 user nova-compute[74131]:   </metadata>
Oct 20 16:54:05 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:54:05 user nova-compute[74131]:     <system>
Oct 20 16:54:05 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:54:05 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:54:05 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:54:05 user nova-compute[74131]:       <entry name="serial">d0e5fd5a-c4c6-4e4b-9a84-0634074dad85</entry>
Oct 20 16:54:05 user nova-compute[74131]:       <entry name="uuid">d0e5fd5a-c4c6-4e4b-9a84-0634074dad85</entry>
Oct 20 16:54:05 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:54:05 user nova-compute[74131]:     </system>
Oct 20 16:54:05 user nova-compute[74131]:   </sysinfo>
Oct 20 16:54:05 user nova-compute[74131]:   <os>
Oct 20 16:54:05 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:54:05 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:54:05 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:54:05 user nova-compute[74131]:   </os>
Oct 20 16:54:05 user nova-compute[74131]:   <features>
Oct 20 16:54:05 user nova-compute[74131]:     <acpi/>
Oct 20 16:54:05 user nova-compute[74131]:     <apic/>
Oct 20 16:54:05 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:54:05 user nova-compute[74131]:   </features>
Oct 20 16:54:05 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:54:05 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:54:05 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:54:05 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:54:05 user nova-compute[74131]:   </clock>
Oct 20 16:54:05 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:54:05 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:54:05 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:54:05 user nova-compute[74131]:   </cpu>
Oct 20 16:54:05 user nova-compute[74131]:   <devices>
Oct 20 16:54:05 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:54:05 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:54:05 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk"/>
Oct 20 16:54:05 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:54:05 user nova-compute[74131]:     </disk>
Oct 20 16:54:05 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:54:05 user nova-compute[74131]:       <mac address="fa:16:3e:6d:cf:db"/>
Oct 20 16:54:05 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:54:05 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:54:05 user nova-compute[74131]:       <target dev="tap4ea24282-5f"/>
Oct 20 16:54:05 user nova-compute[74131]:     </interface>
Oct 20 16:54:05 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:54:05 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/console.log" append="off"/>
Oct 20 16:54:05 user nova-compute[74131]:     </serial>
Oct 20 16:54:05 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:54:05 user nova-compute[74131]:     <video>
Oct 20 16:54:05 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:54:05 user nova-compute[74131]:     </video>
Oct 20 16:54:05 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:54:05 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:54:05 user nova-compute[74131]:     </rng>
Oct 20 16:54:05 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:54:05 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:54:05 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:54:05 user nova-compute[74131]:     </memballoon>
Oct 20 16:54:05 user nova-compute[74131]:   </devices>
Oct 20 16:54:05 user nova-compute[74131]: </domain>
Oct 20 16:54:05 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1614270774',display_name='tempest-ServerRescueNegativeTestJSON-server-1614270774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1614270774',id=49,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/EGBllymBtG8XiDGo9+JNNczOkzoT8MnSRFsQrp3oWPdHU3Je2iDE0WXNhvjXBVYl1fj/v+VUL3iR1hGxpov6hrjoVPk216oirtcvlKw1TVIOSleZD8M+FFDpg3gOgGQ==',key_name='tempest-keypair-1248974718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-8lxivsi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=d0e5fd5a-c4c6-4e4b-9a84-0634074dad85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG os_vif [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7afb1d51-c59a-5fe3-94c5-626c5c68de66', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ea24282-5f, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ea24282-5f, col_values=(('qos', UUID('5549f89e-7eae-42ef-ad45-7baf9d653475')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ea24282-5f, col_values=(('external_ids', {'iface-id': '4ea24282-5f57-4c96-855f-5f6625a5c9be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:cf:db', 'vm-uuid': 'd0e5fd5a-c4c6-4e4b-9a84-0634074dad85'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:05 user nova-compute[74131]: INFO os_vif [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f')
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No VIF found with MAC fa:16:3e:6d:cf:db, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.neutron [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updated VIF entry in instance network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG nova.network.neutron [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:54:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-aa535d63-0bf3-4250-afd2-893d977dd603 req-2df31fca-83db-4269-bd32-8ab2bdea668d service nova] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:54:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:54:07 user nova-compute[74131]: WARNING nova.compute.manager [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state building and task_state spawning.
Oct 20 16:54:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:54:07 user nova-compute[74131]: WARNING nova.compute.manager [req-31ef6d72-d58a-4d50-8b6e-66c43f43c403 req-320e2522-e30a-44b7-8070-e4b9bd3011d3 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state building and task_state spawning.
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:54:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance spawned successfully.
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:54:08 user nova-compute[74131]: INFO nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Took 5.20 seconds to spawn the instance on the hypervisor.
Oct 20 16:54:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:54:08 user nova-compute[74131]: INFO nova.compute.manager [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Took 5.77 seconds to build instance.
Oct 20 16:54:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-af9465e3-09bd-4d07-a6ed-5b0e6d095415 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.864s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:54:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-changed-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Refreshing instance network info cache due to event network-changed-eba08665-f7a3-4860-a670-ac09557f7b17. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] Acquiring lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] Acquired lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Refreshing network info cache for port eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'flavor' on Instance uuid d14f1277-c033-4cae-ad33-b8df0e5b5689 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:54:35 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Ignoring supplied device name: /dev/vdb
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:35 user nova-compute[74131]: INFO nova.compute.manager [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Attaching volume 337ae377-5c09-4ff2-bf7f-5648b6fb4451 to /dev/vdb
Oct 20 16:54:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Updated VIF entry in instance network info cache for port eba08665-f7a3-4860-a670-ac09557f7b17. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Updating instance_info_cache with network_info: [{"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG os_brick.utils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-058b8c8e-be16-47e4-b76c-5468e7e02f65 req-15272c05-df9c-497d-8170-c9f3eea230b9 service nova] Releasing lock "refresh_cache-d14f1277-c033-4cae-ad33-b8df0e5b5689" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4309cd5d-ab79-4652-8321-a366cc165f2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c239dd2-0722-449a-a7a0-80346d93f78e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[59714111-23f4-41ec-874c-222e00d2ff71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15655c9-29d8-454c-a83f-32657b8aa592]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:35 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:54:36 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:54:36 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6847c97-15b5-4f3c-a766-8ceeb00eb300]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG os_brick.utils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:54:36 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Updating existing volume attachment record: 942eb57b-0b54-4308-ba7c-716fd5910942 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:54:37 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:54:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:54:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:54:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:54:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:54:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:54:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:54:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:54:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:54:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:54:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:54:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:50 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:54:50 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHEcYqOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:54:52 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:54:52 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:54:52 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d2127-1782-4444-9e58-ca0d3587af06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:54:52 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9736ad0c-a4bf-454b-8c8f-2a3bbe46a865]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451] added
Oct 20 16:54:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6227a9-ec6a-41b3-89c1-414465263fd6]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d94fc61-8a0f-406e-b212-4fe32e2159c3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHEcYqOX {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHEcYqOX" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94559d1-df0c-4ced-a507-c1cd3688edd3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHEcYqOX'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ae7fc-c11c-4bf9-a224-b1bd4126dace]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4fce28-d5e4-4071-bc50-2f38f75c8ba8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:54:52 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:54:52 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:54:52 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 16:54:52 user nova-compute[74131]: 
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb6a0f-780c-4c83-baa1-55925caa8124]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260]
Oct 20 16:54:52 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260] successful.
Oct 20 16:54:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992f4bb-07af-4347-9b51-448ab0da5c17]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f439f64e-c48c-4b13-aff9-086106add315]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 (non-flash)
Oct 20 16:54:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 (non-flash)
Oct 20 16:54:52 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[958f2007-8b8c-4a41-a39e-195b006fc9da]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHEcYqOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:54:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:54:53 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:54:53 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=25.014434814453125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d14f1277-c033-4cae-ad33-b8df0e5b5689 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26636393432343862', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636393432343862', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.objects.instance [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'flavor' on Instance uuid d14f1277-c033-4cae-ad33-b8df0e5b5689 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:54:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:54:53 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:54:53 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:54:53 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:54:53 user nova-compute[74131]:   <serial>337ae377-5c09-4ff2-bf7f-5648b6fb4451</serial>
Oct 20 16:54:53 user nova-compute[74131]: </disk>
Oct 20 16:54:53 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:54:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:54:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:54:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] No VIF found with MAC fa:16:3e:94:d8:e7, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:54:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-c01f3a31-f18c-473b-8cad-aabe68f1587b tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.589s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:54:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:54:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Verify base images {{(pid=74131) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Image id 5632de9b-7b89-4624-9137-cb6ef38be112 yields fingerprint 71201ffb40ef43eaeab83d5041f5b38c691b569e {{(pid=74131) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 16:55:04 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] image 5632de9b-7b89-4624-9137-cb6ef38be112 at (/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e): checking
Oct 20 16:55:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] image 5632de9b-7b89-4624-9137-cb6ef38be112 at (/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e): image is in use {{(pid=74131) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74131) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] a32a162c-9a8f-4b69-95e0-425f75d234bf is a valid instance name {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] a32a162c-9a8f-4b69-95e0-425f75d234bf has a disk file {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 16:55:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf is backed by 71201ffb40ef43eaeab83d5041f5b38c691b569e {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] 72c13338-0ecf-4383-a9db-b316bda13601 is a valid instance name {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] 72c13338-0ecf-4383-a9db-b316bda13601 has a disk file {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 is backed by 71201ffb40ef43eaeab83d5041f5b38c691b569e {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] d14f1277-c033-4cae-ad33-b8df0e5b5689 is a valid instance name {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] d14f1277-c033-4cae-ad33-b8df0e5b5689 has a disk file {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d14f1277-c033-4cae-ad33-b8df0e5b5689 is backed by 71201ffb40ef43eaeab83d5041f5b38c691b569e {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 is a valid instance name {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 has a disk file {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 is backed by 71201ffb40ef43eaeab83d5041f5b38c691b569e {{(pid=74131) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 16:55:05 user nova-compute[74131]: WARNING nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e
Oct 20 16:55:05 user nova-compute[74131]: WARNING nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913
Oct 20 16:55:05 user nova-compute[74131]: WARNING nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517
Oct 20 16:55:05 user nova-compute[74131]: WARNING nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601
Oct 20 16:55:05 user nova-compute[74131]: WARNING nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18
Oct 20 16:55:05 user nova-compute[74131]: WARNING nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84
Oct 20 16:55:05 user nova-compute[74131]: WARNING nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Active base files: /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Removable base files: /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913 /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517 /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601 /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18 /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84 /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5959b41d4524eb27e8fb5b401d9b22abc7377c6e
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e6ad8a29898e606e7a66fbbfc7266f9ecf4a5913
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fe465a7fac4b0aac4951fd525532f5ead78e5517
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f32f7af4221d855baf684afeb7e6def276b5a601
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/957ffa6e5512c158fd34d5e35a9bd16b6fb9ac18
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/28406df8404652d0de3274e8f2192953f7d33d84
Oct 20 16:55:05 user nova-compute[74131]: INFO nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57dd5aa6c644d539b13d898245d60d79cfb5d502
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Verification complete {{(pid=74131) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Verify swap images {{(pid=74131) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 16:55:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.imagecache [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Verify ephemeral images {{(pid=74131) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 16:55:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:55:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:55:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:55:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:38 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:39 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 16:55:40 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 16:55:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 16:55:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:55:43 user nova-compute[74131]: INFO nova.compute.manager [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Detaching volume 337ae377-5c09-4ff2-bf7f-5648b6fb4451
Oct 20 16:55:43 user nova-compute[74131]: INFO nova.virt.block_device [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Attempting to driver detach volume 337ae377-5c09-4ff2-bf7f-5648b6fb4451 from mountpoint /dev/vdb
Oct 20 16:55:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Attempting to detach device vdb from instance d14f1277-c033-4cae-ad33-b8df0e5b5689 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:55:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:55:43 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:55:43 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:55:43 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:55:43 user nova-compute[74131]:   <serial>337ae377-5c09-4ff2-bf7f-5648b6fb4451</serial>
Oct 20 16:55:43 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:55:43 user nova-compute[74131]: </disk>
Oct 20 16:55:43 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:55:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully detached device vdb from instance d14f1277-c033-4cae-ad33-b8df0e5b5689 from the persistent domain config.
Oct 20 16:55:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d14f1277-c033-4cae-ad33-b8df0e5b5689 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:55:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:55:43 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:55:43 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:55:43 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:55:43 user nova-compute[74131]:   <serial>337ae377-5c09-4ff2-bf7f-5648b6fb4451</serial>
Oct 20 16:55:43 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:55:43 user nova-compute[74131]: </disk>
Oct 20 16:55:43 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:55:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:44 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d14f1277-c033-4cae-ad33-b8df0e5b5689 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:55:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:55:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:55:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:55:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:55:49 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:55:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:55:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:55:51 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:55:51 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:55:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8699MB free_disk=25.01207733154297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.manager [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing instance network info cache due to event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d14f1277-c033-4cae-ad33-b8df0e5b5689 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.objects.instance [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'flavor' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updated VIF entry in instance network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.network.neutron [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7d0bb286-5b7e-4d98-8575-a3b63358256e req-ad601dd2-8db0-4f9f-8726-eecb5475e32b service nova] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:55:54 user nova-compute[74131]: INFO nova.compute.manager [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Attaching volume 65d3bb58-b111-4344-bb84-e1fc801cdee4 to /dev/vdb
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG os_brick.utils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5703c9f3-0d69-46af-9ce1-3fcbb0c5ed7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73ed0ea-3dc3-4205-865c-3ef30412f3ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[485efaf1-6341-428e-b7ea-33ea63af1330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d361cc-2e88-4712-80f8-a4bb46bbcbbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:55:54 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 16:55:54 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15b0ce-3428-416a-b485-1350a0400359]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG os_brick.utils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:55:54 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating existing volume attachment record: 39d4db41-6773-4541-8d65-4c2d7b646b25 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 16:55:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:55:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:55:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:55:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d14f1277-c033-4cae-ad33-b8df0e5b5689 is timed out.
Oct 20 16:56:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully detached device vdb from instance d14f1277-c033-4cae-ad33-b8df0e5b5689 from the live domain config.
Oct 20 16:56:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHEcYqOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:56:04 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[62887487-cd8a-413b-a298-c9e86ad234c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 16:56:04 user nova-compute[74131]: No targets found.
Oct 20 16:56:04 user nova-compute[74131]: iSNS:
Oct 20 16:56:04 user nova-compute[74131]: No targets found.
Oct 20 16:56:04 user nova-compute[74131]: STATIC:
Oct 20 16:56:04 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451
Oct 20 16:56:04 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 16:56:04 user nova-compute[74131]:                 Iface Name: default
Oct 20 16:56:04 user nova-compute[74131]: FIRMWARE:
Oct 20 16:56:04 user nova-compute[74131]: No targets found.
Oct 20 16:56:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 16:56:04 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 16:56:04 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63b1c1-62c3-4e78-846d-3ec8a27989fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77f828-4609-499d-b32c-16b38a0c85bd]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 (non-flash)
Oct 20 16:56:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 (non-flash)
Oct 20 16:56:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c81f1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d2f07-d640-49ea-bc00-c0605deed129]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6dde60-20b0-4a9a-a366-4a6ddc03b8fa]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8b06c9-c7d3-4489-93c7-234f6b19f2c5]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f919177-d655-41b5-962a-5ddb4ba77c01]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[351ca867-a08e-4608-a1c8-c7dfdaae89c2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68e1c3-6b1e-4d3b-a283-ae21b5085da6]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260]
Oct 20 16:56:04 user nova-compute[74131]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451, portal: 172.16.0.220,3260] successful.
Oct 20 16:56:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19fbce-324e-4d8a-bcce-7f26e8cdbaf8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== disconnect_volume: return (292ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:56:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG nova.objects.instance [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'flavor' on Instance uuid d14f1277-c033-4cae-ad33-b8df0e5b5689 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-57098612-835a-4966-9d43-7fe3635af7d4 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.547s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:05 user nova-compute[74131]: INFO nova.compute.manager [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Terminating instance
Oct 20 16:56:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-fec23a98-afaa-404a-9814-065858221022 req-e3238b52-3cc5-4d6b-99f0-437de8311327 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-vif-unplugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fec23a98-afaa-404a-9814-065858221022 req-e3238b52-3cc5-4d6b-99f0-437de8311327 service nova] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fec23a98-afaa-404a-9814-065858221022 req-e3238b52-3cc5-4d6b-99f0-437de8311327 service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fec23a98-afaa-404a-9814-065858221022 req-e3238b52-3cc5-4d6b-99f0-437de8311327 service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-fec23a98-afaa-404a-9814-065858221022 req-e3238b52-3cc5-4d6b-99f0-437de8311327 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] No waiting events found dispatching network-vif-unplugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:56:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-fec23a98-afaa-404a-9814-065858221022 req-e3238b52-3cc5-4d6b-99f0-437de8311327 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-vif-unplugged-eba08665-f7a3-4860-a670-ac09557f7b17 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 16:56:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Instance destroyed successfully.
Oct 20 16:56:05 user nova-compute[74131]: DEBUG nova.objects.instance [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lazy-loading 'resources' on Instance uuid d14f1277-c033-4cae-ad33-b8df0e5b5689 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1061073045',display_name='tempest-VolumesSnapshotTestJSON-instance-1061073045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1061073045',id=48,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0DLgr2Vgip2D8SPrISpPZV5vFlifjRx1rkQCprV9Oxfa0mDJifkRk/bQUhSkMpjPqKEOy3Jd19IyQl4W9jEk2ZyQLH4ER+rWeHLGXwUBRBdrwfIqUdrFL9drIOuSVk8g==',key_name='tempest-keypair-236013654',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50c3242b8cff4e818350224d48bdc2b3',ramdisk_id='',reservation_id='r-7f5tran1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1859134084',owner_user_name='tempest-VolumesSnapshotTestJSON-1859134084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79ecc014bff9436fa3a56b07eb000e5b',uuid=d14f1277-c033-4cae-ad33-b8df0e5b5689,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converting VIF {"id": "eba08665-f7a3-4860-a670-ac09557f7b17", "address": "fa:16:3e:94:d8:e7", "network": {"id": "7644beb3-a57d-44dd-91ca-5d8191025ad9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-64955652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50c3242b8cff4e818350224d48bdc2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba08665-f7", "ovs_interfaceid": "eba08665-f7a3-4860-a670-ac09557f7b17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=eba08665-f7a3-4860-a670-ac09557f7b17,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba08665-f7') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG os_vif [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=eba08665-f7a3-4860-a670-ac09557f7b17,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba08665-f7') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeba08665-f7, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcf84171-c7e0-4e95-a110-a8c18f3ef0a8) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:56:06 user nova-compute[74131]: INFO os_vif [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=eba08665-f7a3-4860-a670-ac09557f7b17,network=Network(7644beb3-a57d-44dd-91ca-5d8191025ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba08665-f7')
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:337ae377-5c09-4ff2-bf7f-5648b6fb4451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHEcYqOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:56:06 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:56:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[6eb22c73-a304-4cf8-8aeb-536b2b50b34c]: Unexpected error while running command.
Oct 20 16:56:06 user nova-compute[74131]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:56:06 user nova-compute[74131]: Exit code: 21
Oct 20 16:56:06 user nova-compute[74131]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:56:06 user nova-compute[74131]: Stderr: '' {{(pid=84843) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 20 16:56:06 user nova-compute[74131]: Traceback (most recent call last):
Oct 20 16:56:06 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 20 16:56:06 user nova-compute[74131]:     ret = func(*f_args, **f_kwargs)
Oct 20 16:56:06 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 20 16:56:06 user nova-compute[74131]:     return func(*args, **kwargs)
Oct 20 16:56:06 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 20 16:56:06 user nova-compute[74131]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 20 16:56:06 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 20 16:56:06 user nova-compute[74131]:     return putils.execute(on_execute=on_execute,
Oct 20 16:56:06 user nova-compute[74131]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 20 16:56:06 user nova-compute[74131]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 20 16:56:06 user nova-compute[74131]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 16:56:06 user nova-compute[74131]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:56:06 user nova-compute[74131]: Exit code: 21
Oct 20 16:56:06 user nova-compute[74131]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:56:06 user nova-compute[74131]: Stderr: ''
Oct 20 16:56:06 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb22c73-a304-4cf8-8aeb-536b2b50b34c]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 16:56:06 user nova-compute[74131]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:56:06 user nova-compute[74131]: Exit code: 21
Oct 20 16:56:06 user nova-compute[74131]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:56:06 user nova-compute[74131]: Stderr: ''
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 20 16:56:06 user nova-compute[74131]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 16:56:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74131) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.030s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] <== disconnect_volume: return (30ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 16:56:06 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Deleting instance files /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689_del
Oct 20 16:56:06 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Deletion of /opt/stack/data/nova/instances/d14f1277-c033-4cae-ad33-b8df0e5b5689_del complete
Oct 20 16:56:06 user nova-compute[74131]: INFO nova.compute.manager [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 20 16:56:06 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 16:56:06 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:56:06 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Took 0.69 seconds to deallocate network for instance.
Oct 20 16:56:06 user nova-compute[74131]: WARNING nova.volume.cinder [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Attachment 942eb57b-0b54-4308-ba7c-716fd5910942 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 942eb57b-0b54-4308-ba7c-716fd5910942. (HTTP 404) (Request-ID: req-c990d87d-f2e8-4436-8038-b137316a088b)
Oct 20 16:56:06 user nova-compute[74131]: INFO nova.compute.manager [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 16:56:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:07 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Deleted allocations for instance d14f1277-c033-4cae-ad33-b8df0e5b5689
Oct 20 16:56:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-9845e0b6-254a-4d67-8c5a-a5b2afc47e59 tempest-VolumesSnapshotTestJSON-1859134084 tempest-VolumesSnapshotTestJSON-1859134084-project-member] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.137s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-442603a7-11ae-43c4-b867-06a87648d0f7 req-eea0a73e-a1f9-4bac-9769-c4a0687cbc55 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-442603a7-11ae-43c4-b867-06a87648d0f7 req-eea0a73e-a1f9-4bac-9769-c4a0687cbc55 service nova] Acquiring lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-442603a7-11ae-43c4-b867-06a87648d0f7 req-eea0a73e-a1f9-4bac-9769-c4a0687cbc55 service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-442603a7-11ae-43c4-b867-06a87648d0f7 req-eea0a73e-a1f9-4bac-9769-c4a0687cbc55 service nova] Lock "d14f1277-c033-4cae-ad33-b8df0e5b5689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-442603a7-11ae-43c4-b867-06a87648d0f7 req-eea0a73e-a1f9-4bac-9769-c4a0687cbc55 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] No waiting events found dispatching network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:56:07 user nova-compute[74131]: WARNING nova.compute.manager [req-442603a7-11ae-43c4-b867-06a87648d0f7 req-eea0a73e-a1f9-4bac-9769-c4a0687cbc55 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received unexpected event network-vif-plugged-eba08665-f7a3-4860-a670-ac09557f7b17 for instance with vm_state deleted and task_state None.
Oct 20 16:56:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-442603a7-11ae-43c4-b867-06a87648d0f7 req-eea0a73e-a1f9-4bac-9769-c4a0687cbc55 service nova] [instance: d14f1277-c033-4cae-ad33-b8df0e5b5689] Received event network-vif-deleted-eba08665-f7a3-4860-a670-ac09557f7b17 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkBiUSYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 16:56:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:56:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 16:56:10 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4812a-78a2-45ff-9be1-19c453b9e059]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 16:56:10 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd13d7-604e-4db9-bf61-ddf755a50f95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4] added
Oct 20 16:56:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[890858a6-260c-4cfc-96b2-4e5ca64fec28]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c22e53-5977-4511-bde4-6da8b014d10b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkBiUSYn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkBiUSYn" returned: 0 in 0.026s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f0a418-baf7-4c0b-a25b-a3dc6b30a888]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bkBiUSYn'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[701649af-ff04-4531-a8c3-38f4b4584fd4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[993ef26a-57f8-4e9e-810f-18ffeadf73fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:56:11 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 16:56:11 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:56:11 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 16:56:11 user nova-compute[74131]: 
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3ceef-74ae-4238-a64d-c3291e688293]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260]
Oct 20 16:56:11 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260] successful.
Oct 20 16:56:11 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1796b002-0a4e-4dcf-8a4f-562f1127606a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf75445-ef85-456f-a163-80d33264732f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 (non-flash)
Oct 20 16:56:11 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 (non-flash)
Oct 20 16:56:11 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab636ff-3e3a-48ff-91ad-bf3ae5c10b94]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 16:56:11 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkBiUSYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26161356365613861', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161356365613861', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG nova.objects.instance [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'flavor' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 16:56:12 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:56:12 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:56:12 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:56:12 user nova-compute[74131]:   <serial>65d3bb58-b111-4344-bb84-e1fc801cdee4</serial>
Oct 20 16:56:12 user nova-compute[74131]: </disk>
Oct 20 16:56:12 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No VIF found with MAC fa:16:3e:6d:cf:db, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:56:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-26771175-aac4-4ac5-9a34-f21e2fcddea8 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.055s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:13 user nova-compute[74131]: INFO nova.compute.manager [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Rescuing
Oct 20 16:56:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:56:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:56:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:56:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:56:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:56:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-c3833ddd-f80c-4124-9333-febc5e9734b8 req-4dcbe024-9b1c-4ed8-92d9-ba1a8bf4e8d8 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c3833ddd-f80c-4124-9333-febc5e9734b8 req-4dcbe024-9b1c-4ed8-92d9-ba1a8bf4e8d8 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c3833ddd-f80c-4124-9333-febc5e9734b8 req-4dcbe024-9b1c-4ed8-92d9-ba1a8bf4e8d8 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c3833ddd-f80c-4124-9333-febc5e9734b8 req-4dcbe024-9b1c-4ed8-92d9-ba1a8bf4e8d8 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.compute.manager [req-c3833ddd-f80c-4124-9333-febc5e9734b8 req-4dcbe024-9b1c-4ed8-92d9-ba1a8bf4e8d8 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:56:14 user nova-compute[74131]: WARNING nova.compute.manager [req-c3833ddd-f80c-4124-9333-febc5e9734b8 req-4dcbe024-9b1c-4ed8-92d9-ba1a8bf4e8d8 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state active and task_state rescuing.
Oct 20 16:56:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance destroyed successfully.
Oct 20 16:56:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Attempting rescue
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74131) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance directory exists: not creating {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 16:56:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Creating image(s)
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'trusted_certs' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue" returned: 0 in 0.060s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'migration_context' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<d0e5fd5a-c4c6-4e4b-9a84-0634074dad85> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Start _get_guest_xml network_info=[{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:6d:cf:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'resources' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<d0e5fd5a-c4c6-4e4b-9a84-0634074dad85> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'numa_topology' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<d0e5fd5a-c4c6-4e4b-9a84-0634074dad85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:56:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:56:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'vcpu_model' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<d0e5fd5a-c4c6-4e4b-9a84-0634074dad85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1614270774',display_name='tempest-ServerRescueNegativeTestJSON-server-1614270774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1614270774',id=49,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/EGBllymBtG8XiDGo9+JNNczOkzoT8MnSRFsQrp3oWPdHU3Je2iDE0WXNhvjXBVYl1fj/v+VUL3iR1hGxpov6hrjoVPk216oirtcvlKw1TVIOSleZD8M+FFDpg3gOgGQ==',key_name='tempest-keypair-1248974718',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-8lxivsi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=d0e5fd5a-c4c6-4e4b-9a84-0634074dad85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:6d:cf:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "vif_mac": "fa:16:3e:6d:cf:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'pci_devices' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.objects.base [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Object Instance<d0e5fd5a-c4c6-4e4b-9a84-0634074dad85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:56:14 user nova-compute[74131]:   <uuid>d0e5fd5a-c4c6-4e4b-9a84-0634074dad85</uuid>
Oct 20 16:56:14 user nova-compute[74131]:   <name>instance-00000031</name>
Oct 20 16:56:14 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:56:14 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:56:14 user nova-compute[74131]:   <metadata>
Oct 20 16:56:14 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:56:14 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:56:14 user nova-compute[74131]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1614270774</nova:name>
Oct 20 16:56:14 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:56:14</nova:creationTime>
Oct 20 16:56:14 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:56:14 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:56:14 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:56:14 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:56:14 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:56:14 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:56:14 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:56:14 user nova-compute[74131]:       <nova:owner>
Oct 20 16:56:14 user nova-compute[74131]:         <nova:user uuid="5bc5139a72784dc8b85c3a17b9ce722d">tempest-ServerRescueNegativeTestJSON-1760443836-project-member</nova:user>
Oct 20 16:56:14 user nova-compute[74131]:         <nova:project uuid="368249a7186c4968a3b8d8fa5fbd8737">tempest-ServerRescueNegativeTestJSON-1760443836</nova:project>
Oct 20 16:56:14 user nova-compute[74131]:       </nova:owner>
Oct 20 16:56:14 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 16:56:14 user nova-compute[74131]:       <nova:ports>
Oct 20 16:56:14 user nova-compute[74131]:         <nova:port uuid="4ea24282-5f57-4c96-855f-5f6625a5c9be">
Oct 20 16:56:14 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 16:56:14 user nova-compute[74131]:         </nova:port>
Oct 20 16:56:14 user nova-compute[74131]:       </nova:ports>
Oct 20 16:56:14 user nova-compute[74131]:     </nova:instance>
Oct 20 16:56:14 user nova-compute[74131]:   </metadata>
Oct 20 16:56:14 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:56:14 user nova-compute[74131]:     <system>
Oct 20 16:56:14 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:56:14 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:56:14 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:56:14 user nova-compute[74131]:       <entry name="serial">d0e5fd5a-c4c6-4e4b-9a84-0634074dad85</entry>
Oct 20 16:56:14 user nova-compute[74131]:       <entry name="uuid">d0e5fd5a-c4c6-4e4b-9a84-0634074dad85</entry>
Oct 20 16:56:14 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:56:14 user nova-compute[74131]:     </system>
Oct 20 16:56:14 user nova-compute[74131]:   </sysinfo>
Oct 20 16:56:14 user nova-compute[74131]:   <os>
Oct 20 16:56:14 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:56:14 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:56:14 user nova-compute[74131]:   </os>
Oct 20 16:56:14 user nova-compute[74131]:   <features>
Oct 20 16:56:14 user nova-compute[74131]:     <acpi/>
Oct 20 16:56:14 user nova-compute[74131]:     <apic/>
Oct 20 16:56:14 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:56:14 user nova-compute[74131]:   </features>
Oct 20 16:56:14 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:56:14 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:56:14 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:56:14 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:56:14 user nova-compute[74131]:   </clock>
Oct 20 16:56:14 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:56:14 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:56:14 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:56:14 user nova-compute[74131]:   </cpu>
Oct 20 16:56:14 user nova-compute[74131]:   <devices>
Oct 20 16:56:14 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:56:14 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:56:14 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue"/>
Oct 20 16:56:14 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:56:14 user nova-compute[74131]:     </disk>
Oct 20 16:56:14 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:56:14 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:56:14 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk"/>
Oct 20 16:56:14 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 16:56:14 user nova-compute[74131]:     </disk>
Oct 20 16:56:14 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:56:14 user nova-compute[74131]:       <mac address="fa:16:3e:6d:cf:db"/>
Oct 20 16:56:14 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:56:14 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:56:14 user nova-compute[74131]:       <target dev="tap4ea24282-5f"/>
Oct 20 16:56:14 user nova-compute[74131]:     </interface>
Oct 20 16:56:14 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:56:14 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/console.log" append="off"/>
Oct 20 16:56:14 user nova-compute[74131]:     </serial>
Oct 20 16:56:14 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:56:14 user nova-compute[74131]:     <video>
Oct 20 16:56:14 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:56:14 user nova-compute[74131]:     </video>
Oct 20 16:56:14 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:56:14 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:56:14 user nova-compute[74131]:     </rng>
Oct 20 16:56:14 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:56:14 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:56:14 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:56:14 user nova-compute[74131]:     </memballoon>
Oct 20 16:56:14 user nova-compute[74131]:   </devices>
Oct 20 16:56:14 user nova-compute[74131]: </domain>
Oct 20 16:56:14 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:56:14 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance destroyed successfully.
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:56:14 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] No VIF found with MAC fa:16:3e:6d:cf:db, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-2477a0af-cefa-4c00-8d30-58a81054e03e req-54026648-5d40-47fd-9b45-faf9300f31e2 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2477a0af-cefa-4c00-8d30-58a81054e03e req-54026648-5d40-47fd-9b45-faf9300f31e2 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2477a0af-cefa-4c00-8d30-58a81054e03e req-54026648-5d40-47fd-9b45-faf9300f31e2 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2477a0af-cefa-4c00-8d30-58a81054e03e req-54026648-5d40-47fd-9b45-faf9300f31e2 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG nova.compute.manager [req-2477a0af-cefa-4c00-8d30-58a81054e03e req-54026648-5d40-47fd-9b45-faf9300f31e2 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:56:16 user nova-compute[74131]: WARNING nova.compute.manager [req-2477a0af-cefa-4c00-8d30-58a81054e03e req-54026648-5d40-47fd-9b45-faf9300f31e2 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state active and task_state rescuing.
Oct 20 16:56:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "72c13338-0ecf-4383-a9db-b316bda13601" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:16 user nova-compute[74131]: INFO nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] During sync_power_state the instance has a pending task (rescuing). Skip.
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "72c13338-0ecf-4383-a9db-b316bda13601" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:56:18 user nova-compute[74131]: WARNING nova.compute.manager [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state active and task_state rescuing.
Oct 20 16:56:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:18 user nova-compute[74131]: DEBUG nova.compute.manager [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:56:18 user nova-compute[74131]: WARNING nova.compute.manager [req-79b1f759-b7aa-4222-b365-440f6cdfb1a6 req-7dcc73e3-157b-4387-971e-77bdd6deb2ce service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state active and task_state rescuing.
Oct 20 16:56:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-830dba7c-8119-443a-869a-29dbf20bc98e tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:56:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:40 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:40 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:40 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:48 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:56:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:56:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:56:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:56:50 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:56:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:56:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:56:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:52 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:56:52 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:53 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:56:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:56:54 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:56:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=25.029560089111328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:56:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:56:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:56:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:56:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:57:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:57:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:57:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:57:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:57:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:57:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:57:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:57:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:42 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:57:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:57:51 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:57:52 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:57:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:57:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:57:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:57:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:57:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:57:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:57:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:57:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:57:56 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:57:56 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:57:56 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.028255462646484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:57:56 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:57:57 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:57:57 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:57:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:57:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:58:04 user nova-compute[74131]: INFO nova.compute.manager [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Unrescuing
Oct 20 16:58:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:58:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:58:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:58:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:58:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:58:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'flavor' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:58:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-8d4848fe-894e-48ff-a198-269ac11b1cac req-903147e0-a891-422e-8c69-2d16e42c67f9 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:58:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8d4848fe-894e-48ff-a198-269ac11b1cac req-903147e0-a891-422e-8c69-2d16e42c67f9 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8d4848fe-894e-48ff-a198-269ac11b1cac req-903147e0-a891-422e-8c69-2d16e42c67f9 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-8d4848fe-894e-48ff-a198-269ac11b1cac req-903147e0-a891-422e-8c69-2d16e42c67f9 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-8d4848fe-894e-48ff-a198-269ac11b1cac req-903147e0-a891-422e-8c69-2d16e42c67f9 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:58:05 user nova-compute[74131]: WARNING nova.compute.manager [req-8d4848fe-894e-48ff-a198-269ac11b1cac req-903147e0-a891-422e-8c69-2d16e42c67f9 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:58:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance destroyed successfully.
Oct 20 16:58:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:58:07 user nova-compute[74131]: WARNING nova.compute.manager [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:58:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:58:07 user nova-compute[74131]: WARNING nova.compute.manager [req-3f7aee7e-c170-4209-b23b-02ba4327ff2d req-a7c3cc4c-6b60-4ac5-a4f7-ea3656e6833c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state rescued and task_state unrescuing.
Oct 20 16:58:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-5da5fd44-5fe6-49be-93ef-bc16da2843bc tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:58:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-2176dc40-5727-430b-9d4a-21beb92b2828 req-0a9d51a7-f7d7-48ac-9a8a-d10a160f2635 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:58:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2176dc40-5727-430b-9d4a-21beb92b2828 req-0a9d51a7-f7d7-48ac-9a8a-d10a160f2635 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2176dc40-5727-430b-9d4a-21beb92b2828 req-0a9d51a7-f7d7-48ac-9a8a-d10a160f2635 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2176dc40-5727-430b-9d4a-21beb92b2828 req-0a9d51a7-f7d7-48ac-9a8a-d10a160f2635 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-2176dc40-5727-430b-9d4a-21beb92b2828 req-0a9d51a7-f7d7-48ac-9a8a-d10a160f2635 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:58:09 user nova-compute[74131]: WARNING nova.compute.manager [req-2176dc40-5727-430b-9d4a-21beb92b2828 req-0a9d51a7-f7d7-48ac-9a8a-d10a160f2635 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state active and task_state None.
Oct 20 16:58:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:58:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 16:58:37 user nova-compute[74131]: INFO nova.compute.claims [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Claim successful on node user
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 16:58:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.policy [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daee6058922b4b4a922cb42b0606adda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6696c177b72435da97dc1c1f8dd5fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 16:58:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Creating image(s)
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "/opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "/opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "874db2251477565ea79bd7455c6133259ea0363f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "874db2251477565ea79bd7455c6133259ea0363f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG nova.network.neutron [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Successfully created port: 017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG nova.virt.images [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] 57e70a1b-f1bd-4d12-bd53-c970f7a93e4d was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.part /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.part /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.converted" returned: 0 in 0.260s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "874db2251477565ea79bd7455c6133259ea0363f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.079s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:38 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "874db2251477565ea79bd7455c6133259ea0363f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "874db2251477565ea79bd7455c6133259ea0363f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Successfully updated port: 017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-changed-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing instance network info cache due to event network-changed-017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f,backing_fmt=raw /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f,backing_fmt=raw /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk 1073741824" returned: 0 in 0.047s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "874db2251477565ea79bd7455c6133259ea0363f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.neutron [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-38230861-4930-453a-9a47-cd5946a6ac93 req-66f3e23a-6dbf-4cbe-8ca0-ba61b74171a2 service nova] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json" returned: 0 in 0.166s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Cannot resize image /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Ensure instance console log exists: /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.neutron [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance network_info: |[{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Start _get_guest_xml network_info=[{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:58:34Z,direct_url=<?>,disk_format='qcow2',id=57e70a1b-f1bd-4d12-bd53-c970f7a93e4d,min_disk=0,min_ram=0,name='tempest-scenario-img--400879390',owner='e6696c177b72435da97dc1c1f8dd5fd6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '57e70a1b-f1bd-4d12-bd53-c970f7a93e4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 16:58:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:58:39 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:58:34Z,direct_url=<?>,disk_format='qcow2',id=57e70a1b-f1bd-4d12-bd53-c970f7a93e4d,min_disk=0,min_ram=0,name='tempest-scenario-img--400879390',owner='e6696c177b72435da97dc1c1f8dd5fd6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687061171',display_name='tempest-TestMinimumBasicScenario-server-1687061171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687061171',id=50,image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+D/tnhpb+3fnQzDwVVMtsKi1ymChvYiR3wtfbUfv+U7caNKlPLZvQpJ0+5yhmHyg3zAAet7pDdnYdtb2WY4rbUeD6cUNeJxVSnZFTK1DAeQrOaJQEKNG+t0sZNmrnWeQ==',key_name='tempest-TestMinimumBasicScenario-1782114326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-26soxpoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:58:38Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=9b88baee-9d54-44f1-ae2f-c51e0c6e95bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.objects.instance [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 16:58:39 user nova-compute[74131]:   <uuid>9b88baee-9d54-44f1-ae2f-c51e0c6e95bb</uuid>
Oct 20 16:58:39 user nova-compute[74131]:   <name>instance-00000032</name>
Oct 20 16:58:39 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 16:58:39 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 16:58:39 user nova-compute[74131]:   <metadata>
Oct 20 16:58:39 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 16:58:39 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 16:58:39 user nova-compute[74131]:       <nova:name>tempest-TestMinimumBasicScenario-server-1687061171</nova:name>
Oct 20 16:58:39 user nova-compute[74131]:       <nova:creationTime>2023-10-20 16:58:39</nova:creationTime>
Oct 20 16:58:39 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 16:58:39 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 16:58:39 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 16:58:39 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 16:58:39 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 16:58:39 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 16:58:39 user nova-compute[74131]:       </nova:flavor>
Oct 20 16:58:39 user nova-compute[74131]:       <nova:owner>
Oct 20 16:58:39 user nova-compute[74131]:         <nova:user uuid="daee6058922b4b4a922cb42b0606adda">tempest-TestMinimumBasicScenario-61770447-project-member</nova:user>
Oct 20 16:58:39 user nova-compute[74131]:         <nova:project uuid="e6696c177b72435da97dc1c1f8dd5fd6">tempest-TestMinimumBasicScenario-61770447</nova:project>
Oct 20 16:58:39 user nova-compute[74131]:       </nova:owner>
Oct 20 16:58:39 user nova-compute[74131]:       <nova:root type="image" uuid="57e70a1b-f1bd-4d12-bd53-c970f7a93e4d"/>
Oct 20 16:58:39 user nova-compute[74131]:       <nova:ports>
Oct 20 16:58:39 user nova-compute[74131]:         <nova:port uuid="017a66ee-908c-481c-8c90-0d27375ff711">
Oct 20 16:58:39 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 16:58:39 user nova-compute[74131]:         </nova:port>
Oct 20 16:58:39 user nova-compute[74131]:       </nova:ports>
Oct 20 16:58:39 user nova-compute[74131]:     </nova:instance>
Oct 20 16:58:39 user nova-compute[74131]:   </metadata>
Oct 20 16:58:39 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 16:58:39 user nova-compute[74131]:     <system>
Oct 20 16:58:39 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 16:58:39 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 16:58:39 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 16:58:39 user nova-compute[74131]:       <entry name="serial">9b88baee-9d54-44f1-ae2f-c51e0c6e95bb</entry>
Oct 20 16:58:39 user nova-compute[74131]:       <entry name="uuid">9b88baee-9d54-44f1-ae2f-c51e0c6e95bb</entry>
Oct 20 16:58:39 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 16:58:39 user nova-compute[74131]:     </system>
Oct 20 16:58:39 user nova-compute[74131]:   </sysinfo>
Oct 20 16:58:39 user nova-compute[74131]:   <os>
Oct 20 16:58:39 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 16:58:39 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 16:58:39 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 16:58:39 user nova-compute[74131]:   </os>
Oct 20 16:58:39 user nova-compute[74131]:   <features>
Oct 20 16:58:39 user nova-compute[74131]:     <acpi/>
Oct 20 16:58:39 user nova-compute[74131]:     <apic/>
Oct 20 16:58:39 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 16:58:39 user nova-compute[74131]:   </features>
Oct 20 16:58:39 user nova-compute[74131]:   <clock offset="utc">
Oct 20 16:58:39 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 16:58:39 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 16:58:39 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 16:58:39 user nova-compute[74131]:   </clock>
Oct 20 16:58:39 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 16:58:39 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 16:58:39 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 16:58:39 user nova-compute[74131]:   </cpu>
Oct 20 16:58:39 user nova-compute[74131]:   <devices>
Oct 20 16:58:39 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 16:58:39 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 16:58:39 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk"/>
Oct 20 16:58:39 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 16:58:39 user nova-compute[74131]:     </disk>
Oct 20 16:58:39 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 16:58:39 user nova-compute[74131]:       <mac address="fa:16:3e:8f:c1:b7"/>
Oct 20 16:58:39 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:58:39 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 16:58:39 user nova-compute[74131]:       <target dev="tap017a66ee-90"/>
Oct 20 16:58:39 user nova-compute[74131]:     </interface>
Oct 20 16:58:39 user nova-compute[74131]:     <serial type="pty">
Oct 20 16:58:39 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/console.log" append="off"/>
Oct 20 16:58:39 user nova-compute[74131]:     </serial>
Oct 20 16:58:39 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 16:58:39 user nova-compute[74131]:     <video>
Oct 20 16:58:39 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 16:58:39 user nova-compute[74131]:     </video>
Oct 20 16:58:39 user nova-compute[74131]:     <rng model="virtio">
Oct 20 16:58:39 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 16:58:39 user nova-compute[74131]:     </rng>
Oct 20 16:58:39 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 16:58:39 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 16:58:39 user nova-compute[74131]:       <stats period="10"/>
Oct 20 16:58:39 user nova-compute[74131]:     </memballoon>
Oct 20 16:58:39 user nova-compute[74131]:   </devices>
Oct 20 16:58:39 user nova-compute[74131]: </domain>
Oct 20 16:58:39 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687061171',display_name='tempest-TestMinimumBasicScenario-server-1687061171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687061171',id=50,image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+D/tnhpb+3fnQzDwVVMtsKi1ymChvYiR3wtfbUfv+U7caNKlPLZvQpJ0+5yhmHyg3zAAet7pDdnYdtb2WY4rbUeD6cUNeJxVSnZFTK1DAeQrOaJQEKNG+t0sZNmrnWeQ==',key_name='tempest-TestMinimumBasicScenario-1782114326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-26soxpoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T16:58:38Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=9b88baee-9d54-44f1-ae2f-c51e0c6e95bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG os_vif [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec569805-5fce-5b6d-b864-3fab740dcd39', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap017a66ee-90, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap017a66ee-90, col_values=(('qos', UUID('6fe950e7-ceed-4946-b905-2c7a211ae5c1')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap017a66ee-90, col_values=(('external_ids', {'iface-id': '017a66ee-908c-481c-8c90-0d27375ff711', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:c1:b7', 'vm-uuid': '9b88baee-9d54-44f1-ae2f-c51e0c6e95bb'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:58:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:39 user nova-compute[74131]: INFO os_vif [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90')
Oct 20 16:58:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 16:58:40 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No VIF found with MAC fa:16:3e:8f:c1:b7, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-b9dac501-59ff-4033-a7d7-a0a790d9542e req-e41dd834-864d-4a79-8f2f-6a2b0cc9dbac service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b9dac501-59ff-4033-a7d7-a0a790d9542e req-e41dd834-864d-4a79-8f2f-6a2b0cc9dbac service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b9dac501-59ff-4033-a7d7-a0a790d9542e req-e41dd834-864d-4a79-8f2f-6a2b0cc9dbac service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b9dac501-59ff-4033-a7d7-a0a790d9542e req-e41dd834-864d-4a79-8f2f-6a2b0cc9dbac service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-b9dac501-59ff-4033-a7d7-a0a790d9542e req-e41dd834-864d-4a79-8f2f-6a2b0cc9dbac service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:58:41 user nova-compute[74131]: WARNING nova.compute.manager [req-b9dac501-59ff-4033-a7d7-a0a790d9542e req-e41dd834-864d-4a79-8f2f-6a2b0cc9dbac service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state building and task_state spawning.
Oct 20 16:58:41 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 16:58:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance spawned successfully.
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 16:58:43 user nova-compute[74131]: INFO nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 16:58:43 user nova-compute[74131]: INFO nova.compute.manager [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Took 6.17 seconds to build instance.
Oct 20 16:58:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-dc3527c1-39f1-4d0b-9e34-3c1264a31c63 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.269s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-7e8d8120-2228-4730-b2c1-4c751235fb38 req-4c19b8cb-aa15-4f5b-b213-c0a945ef2129 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7e8d8120-2228-4730-b2c1-4c751235fb38 req-4c19b8cb-aa15-4f5b-b213-c0a945ef2129 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7e8d8120-2228-4730-b2c1-4c751235fb38 req-4c19b8cb-aa15-4f5b-b213-c0a945ef2129 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-7e8d8120-2228-4730-b2c1-4c751235fb38 req-4c19b8cb-aa15-4f5b-b213-c0a945ef2129 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:43 user nova-compute[74131]: DEBUG nova.compute.manager [req-7e8d8120-2228-4730-b2c1-4c751235fb38 req-4c19b8cb-aa15-4f5b-b213-c0a945ef2129 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 16:58:43 user nova-compute[74131]: WARNING nova.compute.manager [req-7e8d8120-2228-4730-b2c1-4c751235fb38 req-4c19b8cb-aa15-4f5b-b213-c0a945ef2129 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state None.
Oct 20 16:58:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:44 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:44 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:58:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:58:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:58:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:58:51 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:58:52 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:58:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:58:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:58:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 16:58:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:58:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8537MB free_disk=24.963855743408203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:58:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:58:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:59:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:59:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:59:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:59:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:49 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 16:59:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 16:59:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 16:59:50 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 16:59:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 16:59:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:59:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:59:53 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 16:59:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:59:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:59:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 16:59:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:55 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 16:59:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 16:59:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:59:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:59:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:59:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 16:59:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.compute.manager [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing instance network info cache due to event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:59:56 user nova-compute[74131]: INFO nova.compute.manager [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Detaching volume 65d3bb58-b111-4344-bb84-e1fc801cdee4
Oct 20 16:59:56 user nova-compute[74131]: INFO nova.virt.block_device [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Attempting to driver detach volume 65d3bb58-b111-4344-bb84-e1fc801cdee4 from mountpoint /dev/vdb
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Attempting to detach device vdb from instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:59:56 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:59:56 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:59:56 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:59:56 user nova-compute[74131]:   <serial>65d3bb58-b111-4344-bb84-e1fc801cdee4</serial>
Oct 20 16:59:56 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:59:56 user nova-compute[74131]: </disk>
Oct 20 16:59:56 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updated VIF entry in instance network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.network.neutron [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:59:56 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully detached device vdb from instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 from the persistent domain config.
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 16:59:56 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 16:59:56 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 16:59:56 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 16:59:56 user nova-compute[74131]:   <serial>65d3bb58-b111-4344-bb84-e1fc801cdee4</serial>
Oct 20 16:59:56 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 16:59:56 user nova-compute[74131]: </disk>
Oct 20 16:59:56 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-744b7d63-33a9-4353-8c68-ce3872ac9871 req-9eb09817-d2a9-4302-8cbb-0a0518048f3c service nova] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 16:59:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 16:59:58 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:59:58 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=24.935420989990234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing instance network info cache due to event network-changed-4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] Acquiring lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] Acquired lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.network.neutron [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Refreshing network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.network.neutron [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updated VIF entry in instance network info cache for port 4ea24282-5f57-4c96-855f-5f6625a5c9be. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG nova.network.neutron [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [{"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 16:59:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-11c055c4-625f-4364-a832-c632397b41b4 req-ac044714-7af8-4378-8ccd-c4abdbffaec6 service nova] Releasing lock "refresh_cache-d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:00:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:00:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:00:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:00:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:00:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:10 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:17 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 is timed out.
Oct 20 17:00:17 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully detached device vdb from instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 from the live domain config.
Oct 20 17:00:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkBiUSYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:00:17 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf72907-469f-4ab3-b529-888a2776b5cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:00:17 user nova-compute[74131]: No targets found.
Oct 20 17:00:17 user nova-compute[74131]: iSNS:
Oct 20 17:00:17 user nova-compute[74131]: No targets found.
Oct 20 17:00:17 user nova-compute[74131]: STATIC:
Oct 20 17:00:17 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4
Oct 20 17:00:17 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:00:17 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:00:17 user nova-compute[74131]: FIRMWARE:
Oct 20 17:00:17 user nova-compute[74131]: No targets found.
Oct 20 17:00:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:00:17 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:00:17 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97ad6b-4334-4b17-b043-b6eda978c4b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b113e8-21bd-474a-84ba-edab2169991a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 (non-flash)
Oct 20 17:00:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 (non-flash)
Oct 20 17:00:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c82e04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[94873352-55d7-4b2d-8f5d-a08c26bc285b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[947274ae-8728-4a64-ad27-f24d8b95b71d]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[13531763-17cb-429d-bbe3-9974e924f2e7]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b14ee80-31ef-4294-af22-8144294eaa38]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f42c1-775c-4b9b-b041-d1796c850f0b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91b0d4-a0ef-4255-9f87-29e3f07d795b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260]
Oct 20 17:00:17 user nova-compute[74131]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4, portal: 172.16.0.220,3260] successful.
Oct 20 17:00:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d3bb58-b111-4344-bb84-e1fc801cdee4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e2d69d-7c11-40f9-8311-bd8cae9dc9b4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] <== disconnect_volume: return (279ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:00:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:00:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'flavor' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:00:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-fd557406-97c8-4b87-b32e-8c07bf4b54b0 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:00:25 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG nova.objects.instance [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'flavor' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:32 user nova-compute[74131]: INFO nova.compute.manager [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Attaching volume 87146b97-d6ea-4912-ad4e-75cd6864c21e to /dev/vdb
Oct 20 17:00:32 user nova-compute[74131]: DEBUG os_brick.utils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e167feb-c92e-4d25-8ae5-d509bb9d0f5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc95416-f859-4646-812c-f7b6baa7bd50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424661a-cfb6-4870-9609-bc8a67d43cb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f762af-dfee-4166-9143-d49b30a5ef52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:00:32 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:00:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e144b-9a0c-4b1a-880e-c739521783ee]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG os_brick.utils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:00:32 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating existing volume attachment record: 8543ade8-9120-4e77-bb46-d277098e219d {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:00:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:00:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:00:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:00:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:00:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:00:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:43 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:46 user nova-compute[74131]: INFO nova.compute.manager [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Terminating instance
Oct 20 17:00:46 user nova-compute[74131]: DEBUG nova.compute.manager [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-d083df55-32e9-48a2-985e-1e3cd6beebdd req-0c768427-d7b5-4c7d-a970-678604e22147 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d083df55-32e9-48a2-985e-1e3cd6beebdd req-0c768427-d7b5-4c7d-a970-678604e22147 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d083df55-32e9-48a2-985e-1e3cd6beebdd req-0c768427-d7b5-4c7d-a970-678604e22147 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d083df55-32e9-48a2-985e-1e3cd6beebdd req-0c768427-d7b5-4c7d-a970-678604e22147 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-d083df55-32e9-48a2-985e-1e3cd6beebdd req-0c768427-d7b5-4c7d-a970-678604e22147 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.compute.manager [req-d083df55-32e9-48a2-985e-1e3cd6beebdd req-0c768427-d7b5-4c7d-a970-678604e22147 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-unplugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Instance destroyed successfully.
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'resources' on Instance uuid d0e5fd5a-c4c6-4e4b-9a84-0634074dad85 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1614270774',display_name='tempest-ServerRescueNegativeTestJSON-server-1614270774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1614270774',id=49,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/EGBllymBtG8XiDGo9+JNNczOkzoT8MnSRFsQrp3oWPdHU3Je2iDE0WXNhvjXBVYl1fj/v+VUL3iR1hGxpov6hrjoVPk216oirtcvlKw1TVIOSleZD8M+FFDpg3gOgGQ==',key_name='tempest-keypair-1248974718',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-8lxivsi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:58:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=d0e5fd5a-c4c6-4e4b-9a84-0634074dad85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "address": "fa:16:3e:6d:cf:db", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea24282-5f", "ovs_interfaceid": "4ea24282-5f57-4c96-855f-5f6625a5c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG os_vif [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ea24282-5f, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5549f89e-7eae-42ef-ad45-7baf9d653475) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:00:47 user nova-compute[74131]: INFO os_vif [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:cf:db,bridge_name='br-int',has_traffic_filtering=True,id=4ea24282-5f57-4c96-855f-5f6625a5c9be,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea24282-5f')
Oct 20 17:00:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Deleting instance files /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85_del
Oct 20 17:00:47 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Deletion of /opt/stack/data/nova/instances/d0e5fd5a-c4c6-4e4b-9a84-0634074dad85_del complete
Oct 20 17:00:47 user nova-compute[74131]: INFO nova.compute.manager [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 17:00:47 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 17:00:47 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtivnOgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:00:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:00:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:00:48 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[498190ce-9889-4a1c-80ff-c5163e7639b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:00:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9132cb46-92f2-4d8f-a902-1777022f15fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e] added
Oct 20 17:00:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097710c-4b30-49c4-9696-68445a56d0e4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d495334-fa96-408c-b770-65f2bc1c887d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtivnOgp {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtivnOgp" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56db7cf-866b-4a7c-abc6-577477a0e8d9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TtivnOgp'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[94651b47-fb2b-4130-a609-38742c614ad1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd9c48-2772-4daf-a94a-a6af1c86d483]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:00:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:00:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:00:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:00:48 user nova-compute[74131]: 
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[61138405-af5a-42db-94fc-37e9627d6d3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]
Oct 20 17:00:48 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.
Oct 20 17:00:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5caacb1-e49c-4f72-a949-117f29a90720]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb18bb1a-6432-4e97-a9eb-beea99560047]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:00:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:00:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6535e8ad-054a-4cd3-8379-010a524d121d]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtivnOgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:00:48 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Took 0.91 seconds to deallocate network for instance.
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:00:48 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:49 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Deleted allocations for instance d0e5fd5a-c4c6-4e4b-9a84-0634074dad85
Oct 20 17:00:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ce724bb4-f6c9-4fef-a62c-f2457111bcd9 tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-e22cf096-4696-456a-a872-fc38ea7acca8 req-3ac3446f-eadf-4975-a4cf-cdb3f442fc34 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e22cf096-4696-456a-a872-fc38ea7acca8 req-3ac3446f-eadf-4975-a4cf-cdb3f442fc34 service nova] Acquiring lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e22cf096-4696-456a-a872-fc38ea7acca8 req-3ac3446f-eadf-4975-a4cf-cdb3f442fc34 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e22cf096-4696-456a-a872-fc38ea7acca8 req-3ac3446f-eadf-4975-a4cf-cdb3f442fc34 service nova] Lock "d0e5fd5a-c4c6-4e4b-9a84-0634074dad85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-e22cf096-4696-456a-a872-fc38ea7acca8 req-3ac3446f-eadf-4975-a4cf-cdb3f442fc34 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] No waiting events found dispatching network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:00:49 user nova-compute[74131]: WARNING nova.compute.manager [req-e22cf096-4696-456a-a872-fc38ea7acca8 req-3ac3446f-eadf-4975-a4cf-cdb3f442fc34 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received unexpected event network-vif-plugged-4ea24282-5f57-4c96-855f-5f6625a5c9be for instance with vm_state deleted and task_state None.
Oct 20 17:00:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-e22cf096-4696-456a-a872-fc38ea7acca8 req-3ac3446f-eadf-4975-a4cf-cdb3f442fc34 service nova] [instance: d0e5fd5a-c4c6-4e4b-9a84-0634074dad85] Received event network-vif-deleted-4ea24282-5f57-4c96-855f-5f6625a5c9be {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23562343037663831', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562343037663831', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'flavor' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:00:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:00:49 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:00:49 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:00:49 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:00:49 user nova-compute[74131]:   <serial>87146b97-d6ea-4912-ad4e-75cd6864c21e</serial>
Oct 20 17:00:49 user nova-compute[74131]: </disk>
Oct 20 17:00:49 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:00:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:00:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:00:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No VIF found with MAC fa:16:3e:8f:c1:b7, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:00:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-18bcb0e8-659b-45ca-a242-bf218a107fb3 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.513s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:50 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 17:00:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:00:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:00:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:00:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:00:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:00:53 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:00:53 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:00:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [{"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:00:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-72c13338-0ecf-4383-a9db-b316bda13601" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:00:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:00:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 17:00:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 17:00:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:00:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:00:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:00:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:00:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=24.962177276611328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 17:00:57 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 17:00:58 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 17:00:58 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:00:58 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:00:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:00:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:00:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-changed-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing instance network info cache due to event network-changed-017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updated VIF entry in instance network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG nova.network.neutron [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e13f475-4e14-46d3-9616-15cb966a3c38 req-9dfdec9b-d784-4920-a19b-c7a292fca742 service nova] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:01:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-changed-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing instance network info cache due to event network-changed-017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updated VIF entry in instance network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:01:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-12d47d69-aaa0-4b3f-8acf-6178dc91f626 req-0de75b38-1328-4490-a3d7-8a0bcd01adff service nova] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:01:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:14 user nova-compute[74131]: INFO nova.compute.manager [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Rebooting instance
Oct 20 17:01:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:01:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:01:14 user nova-compute[74131]: DEBUG nova.network.neutron [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e63682a-c77c-451c-994c-2b92877f0e55 req-04e62c01-f453-4415-829c-b246adde503f service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e63682a-c77c-451c-994c-2b92877f0e55 req-04e62c01-f453-4415-829c-b246adde503f service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e63682a-c77c-451c-994c-2b92877f0e55 req-04e62c01-f453-4415-829c-b246adde503f service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-4e63682a-c77c-451c-994c-2b92877f0e55 req-04e62c01-f453-4415-829c-b246adde503f service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG nova.compute.manager [req-4e63682a-c77c-451c-994c-2b92877f0e55 req-04e62c01-f453-4415-829c-b246adde503f service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:15 user nova-compute[74131]: WARNING nova.compute.manager [req-4e63682a-c77c-451c-994c-2b92877f0e55 req-04e62c01-f453-4415-829c-b246adde503f service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:15 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance destroyed successfully.
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'resources' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687061171',display_name='tempest-TestMinimumBasicScenario-server-1687061171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687061171',id=50,image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+D/tnhpb+3fnQzDwVVMtsKi1ymChvYiR3wtfbUfv+U7caNKlPLZvQpJ0+5yhmHyg3zAAet7pDdnYdtb2WY4rbUeD6cUNeJxVSnZFTK1DAeQrOaJQEKNG+t0sZNmrnWeQ==',key_name='tempest-TestMinimumBasicScenario-1782114326',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-26soxpoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T17:01:15Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=9b88baee-9d54-44f1-ae2f-c51e0c6e95bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_vif [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap017a66ee-90, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fe950e7-ceed-4946-b905-2c7a211ae5c1) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:01:16 user nova-compute[74131]: INFO os_vif [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90')
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtivnOgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:01:16 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[118cbf3c-3c68-41ac-9301-4c042740634e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:01:16 user nova-compute[74131]: No targets found.
Oct 20 17:01:16 user nova-compute[74131]: iSNS:
Oct 20 17:01:16 user nova-compute[74131]: No targets found.
Oct 20 17:01:16 user nova-compute[74131]: STATIC:
Oct 20 17:01:16 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e
Oct 20 17:01:16 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:01:16 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:01:16 user nova-compute[74131]: FIRMWARE:
Oct 20 17:01:16 user nova-compute[74131]: No targets found.
Oct 20 17:01:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:01:16 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:01:16 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c41e5ec-86a3-476e-b38e-1cc05188d5b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266f873-e740-45b1-af1c-e144b5d6159e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:01:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:01:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70e0158b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5b1b2d-1dd8-46f2-8c34-3bc55df246d7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c7625-fcf4-4972-a9e8-dfbe97808612]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c988b95-66a2-4431-96b8-1592cc8e1e6b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c71b5-91ad-4d13-9e24-3ddfab65fc7c]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4aa68-aa15-4d4d-b624-88c03771b5f6]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99fa3ed-91b3-4d43-a644-0fd14bb87d78]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]
Oct 20 17:01:16 user nova-compute[74131]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.
Oct 20 17:01:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9998537-c01f-4632-bb84-06c1a0f97a55]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== disconnect_volume: return (317ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Start _get_guest_xml network_info=[{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e70a1b-f1bd-4d12-bd53-c970f7a93e4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '57e70a1b-f1bd-4d12-bd53-c970f7a93e4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8543ade8-9120-4e77-bb46-d277098e219d', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtivnOgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9b88baee-9d54-44f1-ae2f-c51e0c6e95bb', 'attached_at': '', 'detached_at': '', 'volume_id': '87146b97-d6ea-4912-ad4e-75cd6864c21e', 'serial': '87146b97-d6ea-4912-ad4e-75cd6864c21e'}, 'volume_type': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 17:01:16 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:01:16 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e70a1b-f1bd-4d12-bd53-c970f7a93e4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.objects.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Object Instance<9b88baee-9d54-44f1-ae2f-c51e0c6e95bb> lazy-loaded attributes: resources,vcpu_model {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtivnOgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:01:16 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:01:16 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:01:16 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6c8480-3bd4-4841-895d-dad2f1c0bea9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:01:16 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc9606b-92d2-4888-882e-2fe0587d71fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e] added
Oct 20 17:01:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47b364e-445f-4797-bbb0-21159d104b09]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b703cce4-43b7-48b8-9fc5-20bbc900eea0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtivnOgp {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtivnOgp" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dee26d-936f-4416-adc2-9de4b88cb96d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TtivnOgp'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c264a346-6ad4-4d78-9050-0b0a1de0238f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a58614-cc25-4c89-9ff5-69177400f584]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:01:16 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:01:16 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:01:16 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:01:16 user nova-compute[74131]: 
Oct 20 17:01:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:17 user nova-compute[74131]: WARNING nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:17 user nova-compute[74131]: WARNING nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:17 user nova-compute[74131]: WARNING nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:17 user nova-compute[74131]: WARNING nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:17 user nova-compute[74131]: WARNING nova.compute.manager [req-13df9333-a4ca-410d-bf27-b4f6d47a3bbe req-1a8cd6a7-c782-4000-a71a-df787c1cb768 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --login" returned: 0 in 1.048s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab8ec84-d35c-43ba-8b35-fb69ef282e8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]
Oct 20 17:01:17 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.
Oct 20 17:01:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350e456-1abf-4d35-bd66-505047ea2e76]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8992af99-175c-4e63-b6cf-231e694a774d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:01:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:01:17 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.258s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37ccaef-06f0-4c02-9cf2-288215eb29b7]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:01:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtivnOgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== connect_volume: return (2289ms) {'type': 'block', 'scsi_wwn': '23562343037663831', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562343037663831', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687061171',display_name='tempest-TestMinimumBasicScenario-server-1687061171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687061171',id=50,image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+D/tnhpb+3fnQzDwVVMtsKi1ymChvYiR3wtfbUfv+U7caNKlPLZvQpJ0+5yhmHyg3zAAet7pDdnYdtb2WY4rbUeD6cUNeJxVSnZFTK1DAeQrOaJQEKNG+t0sZNmrnWeQ==',key_name='tempest-TestMinimumBasicScenario-1782114326',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-26soxpoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T17:01:15Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=9b88baee-9d54-44f1-ae2f-c51e0c6e95bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG nova.objects.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Object Instance<9b88baee-9d54-44f1-ae2f-c51e0c6e95bb> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 17:01:18 user nova-compute[74131]:   <uuid>9b88baee-9d54-44f1-ae2f-c51e0c6e95bb</uuid>
Oct 20 17:01:18 user nova-compute[74131]:   <name>instance-00000032</name>
Oct 20 17:01:18 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 17:01:18 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 17:01:18 user nova-compute[74131]:   <metadata>
Oct 20 17:01:18 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 17:01:18 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 17:01:18 user nova-compute[74131]:       <nova:name>tempest-TestMinimumBasicScenario-server-1687061171</nova:name>
Oct 20 17:01:18 user nova-compute[74131]:       <nova:creationTime>2023-10-20 17:01:16</nova:creationTime>
Oct 20 17:01:18 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 17:01:18 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 17:01:18 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 17:01:18 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 17:01:18 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 17:01:18 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 17:01:18 user nova-compute[74131]:       </nova:flavor>
Oct 20 17:01:18 user nova-compute[74131]:       <nova:owner>
Oct 20 17:01:18 user nova-compute[74131]:         <nova:user uuid="daee6058922b4b4a922cb42b0606adda">tempest-TestMinimumBasicScenario-61770447-project-member</nova:user>
Oct 20 17:01:18 user nova-compute[74131]:         <nova:project uuid="e6696c177b72435da97dc1c1f8dd5fd6">tempest-TestMinimumBasicScenario-61770447</nova:project>
Oct 20 17:01:18 user nova-compute[74131]:       </nova:owner>
Oct 20 17:01:18 user nova-compute[74131]:       <nova:root type="image" uuid="57e70a1b-f1bd-4d12-bd53-c970f7a93e4d"/>
Oct 20 17:01:18 user nova-compute[74131]:       <nova:ports>
Oct 20 17:01:18 user nova-compute[74131]:         <nova:port uuid="017a66ee-908c-481c-8c90-0d27375ff711">
Oct 20 17:01:18 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 17:01:18 user nova-compute[74131]:         </nova:port>
Oct 20 17:01:18 user nova-compute[74131]:       </nova:ports>
Oct 20 17:01:18 user nova-compute[74131]:     </nova:instance>
Oct 20 17:01:18 user nova-compute[74131]:   </metadata>
Oct 20 17:01:18 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 17:01:18 user nova-compute[74131]:     <system>
Oct 20 17:01:18 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 17:01:18 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 17:01:18 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 17:01:18 user nova-compute[74131]:       <entry name="serial">9b88baee-9d54-44f1-ae2f-c51e0c6e95bb</entry>
Oct 20 17:01:18 user nova-compute[74131]:       <entry name="uuid">9b88baee-9d54-44f1-ae2f-c51e0c6e95bb</entry>
Oct 20 17:01:18 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 17:01:18 user nova-compute[74131]:     </system>
Oct 20 17:01:18 user nova-compute[74131]:   </sysinfo>
Oct 20 17:01:18 user nova-compute[74131]:   <os>
Oct 20 17:01:18 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 17:01:18 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 17:01:18 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 17:01:18 user nova-compute[74131]:   </os>
Oct 20 17:01:18 user nova-compute[74131]:   <features>
Oct 20 17:01:18 user nova-compute[74131]:     <acpi/>
Oct 20 17:01:18 user nova-compute[74131]:     <apic/>
Oct 20 17:01:18 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 17:01:18 user nova-compute[74131]:   </features>
Oct 20 17:01:18 user nova-compute[74131]:   <clock offset="utc">
Oct 20 17:01:18 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 17:01:18 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 17:01:18 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 17:01:18 user nova-compute[74131]:   </clock>
Oct 20 17:01:18 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 17:01:18 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 17:01:18 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 17:01:18 user nova-compute[74131]:   </cpu>
Oct 20 17:01:18 user nova-compute[74131]:   <devices>
Oct 20 17:01:18 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 17:01:18 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 17:01:18 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk"/>
Oct 20 17:01:18 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 17:01:18 user nova-compute[74131]:     </disk>
Oct 20 17:01:18 user nova-compute[74131]:     <disk type="block" device="disk">
Oct 20 17:01:18 user nova-compute[74131]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:01:18 user nova-compute[74131]:       <source dev="/dev/sdb"/>
Oct 20 17:01:18 user nova-compute[74131]:       <target dev="vdb" bus="virtio"/>
Oct 20 17:01:18 user nova-compute[74131]:       <serial>87146b97-d6ea-4912-ad4e-75cd6864c21e</serial>
Oct 20 17:01:18 user nova-compute[74131]:     </disk>
Oct 20 17:01:18 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 17:01:18 user nova-compute[74131]:       <mac address="fa:16:3e:8f:c1:b7"/>
Oct 20 17:01:18 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:01:18 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 17:01:18 user nova-compute[74131]:       <target dev="tap017a66ee-90"/>
Oct 20 17:01:18 user nova-compute[74131]:     </interface>
Oct 20 17:01:18 user nova-compute[74131]:     <serial type="pty">
Oct 20 17:01:18 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/console.log" append="off"/>
Oct 20 17:01:18 user nova-compute[74131]:     </serial>
Oct 20 17:01:18 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 17:01:18 user nova-compute[74131]:     <video>
Oct 20 17:01:18 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:01:18 user nova-compute[74131]:     </video>
Oct 20 17:01:18 user nova-compute[74131]:     <rng model="virtio">
Oct 20 17:01:18 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 17:01:18 user nova-compute[74131]:     </rng>
Oct 20 17:01:18 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 17:01:18 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 17:01:18 user nova-compute[74131]:       <stats period="10"/>
Oct 20 17:01:18 user nova-compute[74131]:     </memballoon>
Oct 20 17:01:18 user nova-compute[74131]:   </devices>
Oct 20 17:01:18 user nova-compute[74131]: </domain>
Oct 20 17:01:18 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 17:01:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.objects.instance [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.objects.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Object Instance<9b88baee-9d54-44f1-ae2f-c51e0c6e95bb> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/874db2251477565ea79bd7455c6133259ea0363f --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Cannot resize image /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.objects.instance [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'migration_context' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.objects.base [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Object Instance<9b88baee-9d54-44f1-ae2f-c51e0c6e95bb> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74131) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687061171',display_name='tempest-TestMinimumBasicScenario-server-1687061171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687061171',id=50,image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+D/tnhpb+3fnQzDwVVMtsKi1ymChvYiR3wtfbUfv+U7caNKlPLZvQpJ0+5yhmHyg3zAAet7pDdnYdtb2WY4rbUeD6cUNeJxVSnZFTK1DAeQrOaJQEKNG+t0sZNmrnWeQ==',key_name='tempest-TestMinimumBasicScenario-1782114326',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-26soxpoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T17:01:15Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=9b88baee-9d54-44f1-ae2f-c51e0c6e95bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG os_vif [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec569805-5fce-5b6d-b864-3fab740dcd39', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap017a66ee-90, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap017a66ee-90, col_values=(('qos', UUID('135c026b-3cb7-4fe2-9ccd-45722b0d5249')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap017a66ee-90, col_values=(('external_ids', {'iface-id': '017a66ee-908c-481c-8c90-0d27375ff711', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:c1:b7', 'vm-uuid': '9b88baee-9d54-44f1-ae2f-c51e0c6e95bb'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:01:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:19 user nova-compute[74131]: INFO os_vif [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90')
Oct 20 17:01:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:20 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-50eb5806-b001-46dd-9ef7-b985a3f58918 req-2eeae4a7-9d5a-4dfe-a577-5128cbcfb4fc service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-50eb5806-b001-46dd-9ef7-b985a3f58918 req-2eeae4a7-9d5a-4dfe-a577-5128cbcfb4fc service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-50eb5806-b001-46dd-9ef7-b985a3f58918 req-2eeae4a7-9d5a-4dfe-a577-5128cbcfb4fc service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-50eb5806-b001-46dd-9ef7-b985a3f58918 req-2eeae4a7-9d5a-4dfe-a577-5128cbcfb4fc service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-50eb5806-b001-46dd-9ef7-b985a3f58918 req-2eeae4a7-9d5a-4dfe-a577-5128cbcfb4fc service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:21 user nova-compute[74131]: WARNING nova.compute.manager [req-50eb5806-b001-46dd-9ef7-b985a3f58918 req-2eeae4a7-9d5a-4dfe-a577-5128cbcfb4fc service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-b0b75bdd-9fe8-4696-9973-de9549490721 req-1c4c848e-1a9a-4c24-ae76-d2a004a999c7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b0b75bdd-9fe8-4696-9973-de9549490721 req-1c4c848e-1a9a-4c24-ae76-d2a004a999c7 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b0b75bdd-9fe8-4696-9973-de9549490721 req-1c4c848e-1a9a-4c24-ae76-d2a004a999c7 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b0b75bdd-9fe8-4696-9973-de9549490721 req-1c4c848e-1a9a-4c24-ae76-d2a004a999c7 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-b0b75bdd-9fe8-4696-9973-de9549490721 req-1c4c848e-1a9a-4c24-ae76-d2a004a999c7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:23 user nova-compute[74131]: WARNING nova.compute.manager [req-b0b75bdd-9fe8-4696-9973-de9549490721 req-1c4c848e-1a9a-4c24-ae76-d2a004a999c7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 17:01:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 17:01:23 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance rebooted successfully.
Oct 20 17:01:23 user nova-compute[74131]: DEBUG nova.compute.manager [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 17:01:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-74f5ce5c-86e1-4d13-be24-8fe47f369316 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.546s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:44 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:01:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:01:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:01:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:01:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:01:54 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [{"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:01:54 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-a32a162c-9a8f-4b69-95e0-425f75d234bf" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:01:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:01:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:01:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:55 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:01:55 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:56 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:01:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:01:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=24.952003479003906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:57 user nova-compute[74131]: INFO nova.compute.manager [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Terminating instance
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 72c13338-0ecf-4383-a9db-b316bda13601 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance a32a162c-9a8f-4b69-95e0-425f75d234bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-d0e76e1d-de83-46b3-8326-e6c4fe700026 req-d0babc52-d85c-46d8-933c-8bbad370b4cd service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-unplugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0e76e1d-de83-46b3-8326-e6c4fe700026 req-d0babc52-d85c-46d8-933c-8bbad370b4cd service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0e76e1d-de83-46b3-8326-e6c4fe700026 req-d0babc52-d85c-46d8-933c-8bbad370b4cd service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-d0e76e1d-de83-46b3-8326-e6c4fe700026 req-d0babc52-d85c-46d8-933c-8bbad370b4cd service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-d0e76e1d-de83-46b3-8326-e6c4fe700026 req-d0babc52-d85c-46d8-933c-8bbad370b4cd service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-unplugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.compute.manager [req-d0e76e1d-de83-46b3-8326-e6c4fe700026 req-d0babc52-d85c-46d8-933c-8bbad370b4cd service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-unplugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Instance destroyed successfully.
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'resources' on Instance uuid a32a162c-9a8f-4b69-95e0-425f75d234bf {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851827302',display_name='tempest-ServerRescueNegativeTestJSON-server-1851827302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851827302',id=45,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:47:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-p459o8s1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:47:20Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=a32a162c-9a8f-4b69-95e0-425f75d234bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "address": "fa:16:3e:49:b4:2c", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acbb837-c9", "ovs_interfaceid": "8acbb837-c91e-4feb-a2f1-dd0db1c69dd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG os_vif [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8acbb837-c9, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21c12c49-6f4b-4657-bf4d-4085af24199d) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: INFO os_vif [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:b4:2c,bridge_name='br-int',has_traffic_filtering=True,id=8acbb837-c91e-4feb-a2f1-dd0db1c69dd6,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acbb837-c9')
Oct 20 17:01:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Deleting instance files /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf_del
Oct 20 17:01:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Deletion of /opt/stack/data/nova/instances/a32a162c-9a8f-4b69-95e0-425f75d234bf_del complete
Oct 20 17:01:58 user nova-compute[74131]: INFO nova.compute.manager [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 17:01:58 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:01:59 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Took 0.56 seconds to deallocate network for instance.
Oct 20 17:01:59 user nova-compute[74131]: DEBUG nova.compute.manager [req-6cc8cc2b-5d20-420d-8b05-da1132c91ecb req-7cd0c632-e1af-457f-ada3-080e3264c31c service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-deleted-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:01:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:01:59 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Deleted allocations for instance a32a162c-9a8f-4b69-95e0-425f75d234bf
Oct 20 17:01:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fc95e87-7a20-4de1-a5ed-4e291c458bde tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.794s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-befad42f-a749-4831-882f-8952b03ed212 req-9793372a-076c-40c5-a3c5-fb50bf626440 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:02:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-befad42f-a749-4831-882f-8952b03ed212 req-9793372a-076c-40c5-a3c5-fb50bf626440 service nova] Acquiring lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-befad42f-a749-4831-882f-8952b03ed212 req-9793372a-076c-40c5-a3c5-fb50bf626440 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-befad42f-a749-4831-882f-8952b03ed212 req-9793372a-076c-40c5-a3c5-fb50bf626440 service nova] Lock "a32a162c-9a8f-4b69-95e0-425f75d234bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:00 user nova-compute[74131]: DEBUG nova.compute.manager [req-befad42f-a749-4831-882f-8952b03ed212 req-9793372a-076c-40c5-a3c5-fb50bf626440 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] No waiting events found dispatching network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:02:00 user nova-compute[74131]: WARNING nova.compute.manager [req-befad42f-a749-4831-882f-8952b03ed212 req-9793372a-076c-40c5-a3c5-fb50bf626440 service nova] [instance: a32a162c-9a8f-4b69-95e0-425f75d234bf] Received unexpected event network-vif-plugged-8acbb837-c91e-4feb-a2f1-dd0db1c69dd6 for instance with vm_state deleted and task_state None.
Oct 20 17:02:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:02:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:02:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:02:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:44 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "72c13338-0ecf-4383-a9db-b316bda13601" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:47 user nova-compute[74131]: INFO nova.compute.manager [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Terminating instance
Oct 20 17:02:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-b23eeeca-30c5-454f-af3e-d98cc3ae81d4 req-05b6f426-4ff8-4f98-b2b2-4d90416dc716 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b23eeeca-30c5-454f-af3e-d98cc3ae81d4 req-05b6f426-4ff8-4f98-b2b2-4d90416dc716 service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b23eeeca-30c5-454f-af3e-d98cc3ae81d4 req-05b6f426-4ff8-4f98-b2b2-4d90416dc716 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b23eeeca-30c5-454f-af3e-d98cc3ae81d4 req-05b6f426-4ff8-4f98-b2b2-4d90416dc716 service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-b23eeeca-30c5-454f-af3e-d98cc3ae81d4 req-05b6f426-4ff8-4f98-b2b2-4d90416dc716 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.compute.manager [req-b23eeeca-30c5-454f-af3e-d98cc3ae81d4 req-05b6f426-4ff8-4f98-b2b2-4d90416dc716 service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-unplugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Instance destroyed successfully.
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.objects.instance [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lazy-loading 'resources' on Instance uuid 72c13338-0ecf-4383-a9db-b316bda13601 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-903614781',display_name='tempest-ServerRescueNegativeTestJSON-server-903614781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-903614781',id=44,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='368249a7186c4968a3b8d8fa5fbd8737',ramdisk_id='',reservation_id='r-wvb9jdcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1760443836',owner_user_name='tempest-ServerRescueNegativeTestJSON-1760443836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T16:52:09Z,user_data=None,user_id='5bc5139a72784dc8b85c3a17b9ce722d',uuid=72c13338-0ecf-4383-a9db-b316bda13601,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converting VIF {"id": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "address": "fa:16:3e:fa:8a:ae", "network": {"id": "f7ac51db-eb91-42bd-aad8-558d28ad4823", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-954208580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "368249a7186c4968a3b8d8fa5fbd8737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb203dd7e-1f", "ovs_interfaceid": "b203dd7e-1fcd-4c66-a7c0-69079cb17f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG os_vif [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb203dd7e-1f, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae686a71-8274-481c-b5b7-8318fcbd554f) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:48 user nova-compute[74131]: INFO os_vif [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f,network=Network(f7ac51db-eb91-42bd-aad8-558d28ad4823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb203dd7e-1f')
Oct 20 17:02:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Deleting instance files /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601_del
Oct 20 17:02:48 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Deletion of /opt/stack/data/nova/instances/72c13338-0ecf-4383-a9db-b316bda13601_del complete
Oct 20 17:02:48 user nova-compute[74131]: INFO nova.compute.manager [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 17:02:48 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 17:02:48 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:02:49 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Took 0.82 seconds to deallocate network for instance.
Oct 20 17:02:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-93940417-901b-4e10-b2f6-754b872b95d2 req-212ba5fd-3b1a-4dda-904d-2a509fad39cd service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-deleted-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:02:49 user nova-compute[74131]: INFO nova.compute.manager [req-93940417-901b-4e10-b2f6-754b872b95d2 req-212ba5fd-3b1a-4dda-904d-2a509fad39cd service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Neutron deleted interface b203dd7e-1fcd-4c66-a7c0-69079cb17f1f; detaching it from the instance and deleting it from the info cache
Oct 20 17:02:49 user nova-compute[74131]: DEBUG nova.network.neutron [req-93940417-901b-4e10-b2f6-754b872b95d2 req-212ba5fd-3b1a-4dda-904d-2a509fad39cd service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-93940417-901b-4e10-b2f6-754b872b95d2 req-212ba5fd-3b1a-4dda-904d-2a509fad39cd service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Detach interface failed, port_id=b203dd7e-1fcd-4c66-a7c0-69079cb17f1f, reason: Instance 72c13338-0ecf-4383-a9db-b316bda13601 could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:02:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:49 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Deleted allocations for instance 72c13338-0ecf-4383-a9db-b316bda13601
Oct 20 17:02:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-00ac7c38-d108-461d-aac5-5a56ff90d79d tempest-ServerRescueNegativeTestJSON-1760443836 tempest-ServerRescueNegativeTestJSON-1760443836-project-member] Lock "72c13338-0ecf-4383-a9db-b316bda13601" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-f9119153-8a97-4ea7-80cd-0fd38764b036 req-37eecbb4-6764-4131-90ad-c67553f466de service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:02:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f9119153-8a97-4ea7-80cd-0fd38764b036 req-37eecbb4-6764-4131-90ad-c67553f466de service nova] Acquiring lock "72c13338-0ecf-4383-a9db-b316bda13601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f9119153-8a97-4ea7-80cd-0fd38764b036 req-37eecbb4-6764-4131-90ad-c67553f466de service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f9119153-8a97-4ea7-80cd-0fd38764b036 req-37eecbb4-6764-4131-90ad-c67553f466de service nova] Lock "72c13338-0ecf-4383-a9db-b316bda13601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:50 user nova-compute[74131]: DEBUG nova.compute.manager [req-f9119153-8a97-4ea7-80cd-0fd38764b036 req-37eecbb4-6764-4131-90ad-c67553f466de service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] No waiting events found dispatching network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:02:50 user nova-compute[74131]: WARNING nova.compute.manager [req-f9119153-8a97-4ea7-80cd-0fd38764b036 req-37eecbb4-6764-4131-90ad-c67553f466de service nova] [instance: 72c13338-0ecf-4383-a9db-b316bda13601] Received unexpected event network-vif-plugged-b203dd7e-1fcd-4c66-a7c0-69079cb17f1f for instance with vm_state deleted and task_state None.
Oct 20 17:02:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:02:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:02:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:02:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:02:55 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:02:55 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:02:56 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:02:56 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:02:56 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:02:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:02:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:02:57 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:02:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:02:58 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:02:58 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.007553100585938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:02:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:03:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-changed-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing instance network info cache due to event network-changed-017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG nova.network.neutron [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG nova.network.neutron [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updated VIF entry in instance network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG nova.network.neutron [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:03:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-35889af4-66dd-417b-b564-d8a5247c2dcb req-bbf93403-ef53-4fc1-8be6-844f3fc2d17d service nova] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-changed-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.compute.manager [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing instance network info cache due to event network-changed-017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.network.neutron [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Refreshing network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:03:07 user nova-compute[74131]: INFO nova.compute.manager [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Detaching volume 87146b97-d6ea-4912-ad4e-75cd6864c21e
Oct 20 17:03:07 user nova-compute[74131]: INFO nova.virt.block_device [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Attempting to driver detach volume 87146b97-d6ea-4912-ad4e-75cd6864c21e from mountpoint /dev/vdb
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Attempting to detach device vdb from instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:03:07 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:03:07 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:03:07 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:03:07 user nova-compute[74131]:   <serial>87146b97-d6ea-4912-ad4e-75cd6864c21e</serial>
Oct 20 17:03:07 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 17:03:07 user nova-compute[74131]: </disk>
Oct 20 17:03:07 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:03:07 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully detached device vdb from instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb from the persistent domain config.
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:03:07 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:03:07 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:03:07 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:03:07 user nova-compute[74131]:   <serial>87146b97-d6ea-4912-ad4e-75cd6864c21e</serial>
Oct 20 17:03:07 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 17:03:07 user nova-compute[74131]: </disk>
Oct 20 17:03:07 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.network.neutron [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updated VIF entry in instance network info cache for port 017a66ee-908c-481c-8c90-0d27375ff711. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG nova.network.neutron [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:03:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f024d492-7e62-41cd-8b5f-a083f465d93b req-b1b6e8fe-d065-4a24-b20e-5171b97d82b7 service nova] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:03:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:03:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:28 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb is timed out.
Oct 20 17:03:28 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully detached device vdb from instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb from the live domain config.
Oct 20 17:03:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtivnOgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:03:28 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2137a-0293-4bf6-b057-6ca01d5357e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:03:28 user nova-compute[74131]: No targets found.
Oct 20 17:03:28 user nova-compute[74131]: iSNS:
Oct 20 17:03:28 user nova-compute[74131]: No targets found.
Oct 20 17:03:28 user nova-compute[74131]: STATIC:
Oct 20 17:03:28 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e
Oct 20 17:03:28 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:03:28 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:03:28 user nova-compute[74131]: FIRMWARE:
Oct 20 17:03:28 user nova-compute[74131]: No targets found.
Oct 20 17:03:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:03:28 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:03:28 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f069fa-4890-4cb3-9d62-1921d94849e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb15cc6-7982-4766-a951-5a3fee9f9ace]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:03:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e (non-flash)
Oct 20 17:03:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a85b3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d31f20-3f9e-41d3-a9f5-7f0234036611]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de710b-75c1-4589-a703-0b16351ad3be]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[800faf80-8644-4c80-810d-cb4c984d17c9]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[82050532-bf58-44a3-bbc4-619e6d7e95c3]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f81222b-9856-4195-b4f8-a948168c467d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9671fca-10c7-4fdc-9c92-7d0910ae2a46]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260]
Oct 20 17:03:28 user nova-compute[74131]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e, portal: 172.16.0.220,3260] successful.
Oct 20 17:03:28 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87146b97-d6ea-4912-ad4e-75cd6864c21e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7e084c-a8af-4b21-b85f-f425eab538c2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== disconnect_volume: return (271ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:03:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:29 user nova-compute[74131]: DEBUG nova.objects.instance [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'flavor' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:03:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-99f3d9fb-72db-4a67-85c0-8eca04b33ff8 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:03:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:40 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:03:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:03:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:03:57 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:03:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:03:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:03:57 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:03:57 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:03:58 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [{"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:03:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:03:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:03:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:03:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:03:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:03:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:03:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:03:59 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:03:59 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:04:00 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:04:00 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:04:00 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=25.00585174560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:04:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:04:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:04:07 user nova-compute[74131]: INFO nova.compute.manager [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Terminating instance
Oct 20 17:04:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-c49f5655-3392-49b5-836a-b7ea74f77ab2 req-82106664-572d-4d79-818a-cb330fc4778d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c49f5655-3392-49b5-836a-b7ea74f77ab2 req-82106664-572d-4d79-818a-cb330fc4778d service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c49f5655-3392-49b5-836a-b7ea74f77ab2 req-82106664-572d-4d79-818a-cb330fc4778d service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c49f5655-3392-49b5-836a-b7ea74f77ab2 req-82106664-572d-4d79-818a-cb330fc4778d service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-c49f5655-3392-49b5-836a-b7ea74f77ab2 req-82106664-572d-4d79-818a-cb330fc4778d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-c49f5655-3392-49b5-836a-b7ea74f77ab2 req-82106664-572d-4d79-818a-cb330fc4778d service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-unplugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 17:04:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Instance destroyed successfully.
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'resources' on Instance uuid 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T16:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687061171',display_name='tempest-TestMinimumBasicScenario-server-1687061171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687061171',id=50,image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+D/tnhpb+3fnQzDwVVMtsKi1ymChvYiR3wtfbUfv+U7caNKlPLZvQpJ0+5yhmHyg3zAAet7pDdnYdtb2WY4rbUeD6cUNeJxVSnZFTK1DAeQrOaJQEKNG+t0sZNmrnWeQ==',key_name='tempest-TestMinimumBasicScenario-1782114326',keypairs=<?>,launch_index=0,launched_at=2023-10-20T16:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-26soxpoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e70a1b-f1bd-4d12-bd53-c970f7a93e4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T17:01:23Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=9b88baee-9d54-44f1-ae2f-c51e0c6e95bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "017a66ee-908c-481c-8c90-0d27375ff711", "address": "fa:16:3e:8f:c1:b7", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017a66ee-90", "ovs_interfaceid": "017a66ee-908c-481c-8c90-0d27375ff711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG os_vif [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap017a66ee-90, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=135c026b-3cb7-4fe2-9ccd-45722b0d5249) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:08 user nova-compute[74131]: INFO os_vif [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c1:b7,bridge_name='br-int',has_traffic_filtering=True,id=017a66ee-908c-481c-8c90-0d27375ff711,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017a66ee-90')
Oct 20 17:04:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Deleting instance files /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb_del
Oct 20 17:04:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Deletion of /opt/stack/data/nova/instances/9b88baee-9d54-44f1-ae2f-c51e0c6e95bb_del complete
Oct 20 17:04:08 user nova-compute[74131]: INFO nova.compute.manager [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 17:04:08 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 17:04:08 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 17:04:09 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:04:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-e2e36f52-f97e-4b2e-890b-3a19143fd357 req-b16ef508-b8ee-4934-aaeb-61aaada0d573 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-deleted-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:04:09 user nova-compute[74131]: INFO nova.compute.manager [req-e2e36f52-f97e-4b2e-890b-3a19143fd357 req-b16ef508-b8ee-4934-aaeb-61aaada0d573 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Neutron deleted interface 017a66ee-908c-481c-8c90-0d27375ff711; detaching it from the instance and deleting it from the info cache
Oct 20 17:04:09 user nova-compute[74131]: DEBUG nova.network.neutron [req-e2e36f52-f97e-4b2e-890b-3a19143fd357 req-b16ef508-b8ee-4934-aaeb-61aaada0d573 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:04:09 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Took 0.48 seconds to deallocate network for instance.
Oct 20 17:04:09 user nova-compute[74131]: DEBUG nova.compute.manager [req-e2e36f52-f97e-4b2e-890b-3a19143fd357 req-b16ef508-b8ee-4934-aaeb-61aaada0d573 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Detach interface failed, port_id=017a66ee-908c-481c-8c90-0d27375ff711, reason: Instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb could not be found. {{(pid=74131) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 17:04:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:04:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:04:09 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:04:09 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:04:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:04:09 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Deleted allocations for instance 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb
Oct 20 17:04:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-4ef5fa81-2558-4b61-a509-754fe7b3c765 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.646s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:04:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-b184bf90-6c51-41a1-9657-9210067c0ecb req-817d4dc7-af8e-4b16-b655-aee2b1fe8e76 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:04:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b184bf90-6c51-41a1-9657-9210067c0ecb req-817d4dc7-af8e-4b16-b655-aee2b1fe8e76 service nova] Acquiring lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:04:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b184bf90-6c51-41a1-9657-9210067c0ecb req-817d4dc7-af8e-4b16-b655-aee2b1fe8e76 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:04:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-b184bf90-6c51-41a1-9657-9210067c0ecb req-817d4dc7-af8e-4b16-b655-aee2b1fe8e76 service nova] Lock "9b88baee-9d54-44f1-ae2f-c51e0c6e95bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:04:10 user nova-compute[74131]: DEBUG nova.compute.manager [req-b184bf90-6c51-41a1-9657-9210067c0ecb req-817d4dc7-af8e-4b16-b655-aee2b1fe8e76 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] No waiting events found dispatching network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:04:10 user nova-compute[74131]: WARNING nova.compute.manager [req-b184bf90-6c51-41a1-9657-9210067c0ecb req-817d4dc7-af8e-4b16-b655-aee2b1fe8e76 service nova] [instance: 9b88baee-9d54-44f1-ae2f-c51e0c6e95bb] Received unexpected event network-vif-plugged-017a66ee-908c-481c-8c90-0d27375ff711 for instance with vm_state deleted and task_state None.
Oct 20 17:04:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:04:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:04:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:04:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:04:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:04:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:04:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:04:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:53 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:04:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:04:58 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:04:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:04:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:04:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 17:05:01 user nova-compute[74131]: INFO nova.compute.claims [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Claim successful on node user
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.134s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 17:05:01 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.policy [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daee6058922b4b4a922cb42b0606adda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6696c177b72435da97dc1c1f8dd5fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 17:05:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 17:05:02 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:05:02 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9131MB free_disk=25.05282974243164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 17:05:02 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Creating image(s)
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "/opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "/opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "8acca37e480cd9b2efac807fe9267c05ec855436" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "8acca37e480cd9b2efac807fe9267c05ec855436" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.part --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:05:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Successfully created port: a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.virt.images [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] 103f1771-1883-4392-8196-6bb6fb365c20 was qcow2, converting to raw {{(pid=74131) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.privsep.utils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74131) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.part /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.converted {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.part /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.converted" returned: 0 in 0.371s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.converted --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "8acca37e480cd9b2efac807fe9267c05ec855436" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.299s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Successfully updated port: a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.compute.manager [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing instance network info cache due to event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436 --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "8acca37e480cd9b2efac807fe9267c05ec855436" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "8acca37e480cd9b2efac807fe9267c05ec855436" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436 --force-share --output=json" returned: 0 in 0.167s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436,backing_fmt=raw /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436,backing_fmt=raw /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk 1073741824" returned: 0 in 0.059s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "8acca37e480cd9b2efac807fe9267c05ec855436" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436 --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance network_info: |[{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8acca37e480cd9b2efac807fe9267c05ec855436 --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Cannot resize image /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Ensure instance console log exists: /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Start _get_guest_xml network_info=[{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T17:04:59Z,direct_url=<?>,disk_format='qcow2',id=103f1771-1883-4392-8196-6bb6fb365c20,min_disk=0,min_ram=0,name='tempest-scenario-img--839933690',owner='e6696c177b72435da97dc1c1f8dd5fd6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T17:05:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '103f1771-1883-4392-8196-6bb6fb365c20'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 17:05:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:05:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T17:04:59Z,direct_url=<?>,disk_format='qcow2',id=103f1771-1883-4392-8196-6bb6fb365c20,min_disk=0,min_ram=0,name='tempest-scenario-img--839933690',owner='e6696c177b72435da97dc1c1f8dd5fd6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T17:05:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-465589598',display_name='tempest-TestMinimumBasicScenario-server-465589598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-465589598',id=51,image_ref='103f1771-1883-4392-8196-6bb6fb365c20',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeGH4Y7+DE4RXUbT5FYVixgAJLrxdhuAHlpsjXK4rMW17AoWICAapwjeV30lSQH8cluVfFdVgYjLFWOD0E96YUlN1kTVrfBIV1284XiXO8Ia3pyPxyNQGw+Kvz6AZEyZw==',key_name='tempest-TestMinimumBasicScenario-650530573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-vvgm0xxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='103f1771-1883-4392-8196-6bb6fb365c20',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T17:05:02Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=3fcd40ec-491e-4fee-9326-a650a6d29bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:37,bridge_name='br-int',has_traffic_filtering=True,id=a050dcc3-0f4d-45a8-be55-43146dc85d9d,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa050dcc3-0f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated VIF entry in instance network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.neutron [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] End _get_guest_xml xml=<domain type="kvm">
Oct 20 17:05:04 user nova-compute[74131]:   <uuid>3fcd40ec-491e-4fee-9326-a650a6d29bbe</uuid>
Oct 20 17:05:04 user nova-compute[74131]:   <name>instance-00000033</name>
Oct 20 17:05:04 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 17:05:04 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 17:05:04 user nova-compute[74131]:   <metadata>
Oct 20 17:05:04 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 17:05:04 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 17:05:04 user nova-compute[74131]:       <nova:name>tempest-TestMinimumBasicScenario-server-465589598</nova:name>
Oct 20 17:05:04 user nova-compute[74131]:       <nova:creationTime>2023-10-20 17:05:04</nova:creationTime>
Oct 20 17:05:04 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 17:05:04 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 17:05:04 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 17:05:04 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 17:05:04 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 17:05:04 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 17:05:04 user nova-compute[74131]:       </nova:flavor>
Oct 20 17:05:04 user nova-compute[74131]:       <nova:owner>
Oct 20 17:05:04 user nova-compute[74131]:         <nova:user uuid="daee6058922b4b4a922cb42b0606adda">tempest-TestMinimumBasicScenario-61770447-project-member</nova:user>
Oct 20 17:05:04 user nova-compute[74131]:         <nova:project uuid="e6696c177b72435da97dc1c1f8dd5fd6">tempest-TestMinimumBasicScenario-61770447</nova:project>
Oct 20 17:05:04 user nova-compute[74131]:       </nova:owner>
Oct 20 17:05:04 user nova-compute[74131]:       <nova:root type="image" uuid="103f1771-1883-4392-8196-6bb6fb365c20"/>
Oct 20 17:05:04 user nova-compute[74131]:       <nova:ports>
Oct 20 17:05:04 user nova-compute[74131]:         <nova:port uuid="a050dcc3-0f4d-45a8-be55-43146dc85d9d">
Oct 20 17:05:04 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 17:05:04 user nova-compute[74131]:         </nova:port>
Oct 20 17:05:04 user nova-compute[74131]:       </nova:ports>
Oct 20 17:05:04 user nova-compute[74131]:     </nova:instance>
Oct 20 17:05:04 user nova-compute[74131]:   </metadata>
Oct 20 17:05:04 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 17:05:04 user nova-compute[74131]:     <system>
Oct 20 17:05:04 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 17:05:04 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 17:05:04 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 17:05:04 user nova-compute[74131]:       <entry name="serial">3fcd40ec-491e-4fee-9326-a650a6d29bbe</entry>
Oct 20 17:05:04 user nova-compute[74131]:       <entry name="uuid">3fcd40ec-491e-4fee-9326-a650a6d29bbe</entry>
Oct 20 17:05:04 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 17:05:04 user nova-compute[74131]:     </system>
Oct 20 17:05:04 user nova-compute[74131]:   </sysinfo>
Oct 20 17:05:04 user nova-compute[74131]:   <os>
Oct 20 17:05:04 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 17:05:04 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 17:05:04 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 17:05:04 user nova-compute[74131]:   </os>
Oct 20 17:05:04 user nova-compute[74131]:   <features>
Oct 20 17:05:04 user nova-compute[74131]:     <acpi/>
Oct 20 17:05:04 user nova-compute[74131]:     <apic/>
Oct 20 17:05:04 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 17:05:04 user nova-compute[74131]:   </features>
Oct 20 17:05:04 user nova-compute[74131]:   <clock offset="utc">
Oct 20 17:05:04 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 17:05:04 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 17:05:04 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 17:05:04 user nova-compute[74131]:   </clock>
Oct 20 17:05:04 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 17:05:04 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 17:05:04 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 17:05:04 user nova-compute[74131]:   </cpu>
Oct 20 17:05:04 user nova-compute[74131]:   <devices>
Oct 20 17:05:04 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 17:05:04 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 17:05:04 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk"/>
Oct 20 17:05:04 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 17:05:04 user nova-compute[74131]:     </disk>
Oct 20 17:05:04 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 17:05:04 user nova-compute[74131]:       <mac address="fa:16:3e:db:93:37"/>
Oct 20 17:05:04 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:05:04 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 17:05:04 user nova-compute[74131]:       <target dev="tapa050dcc3-0f"/>
Oct 20 17:05:04 user nova-compute[74131]:     </interface>
Oct 20 17:05:04 user nova-compute[74131]:     <serial type="pty">
Oct 20 17:05:04 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/console.log" append="off"/>
Oct 20 17:05:04 user nova-compute[74131]:     </serial>
Oct 20 17:05:04 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 17:05:04 user nova-compute[74131]:     <video>
Oct 20 17:05:04 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:05:04 user nova-compute[74131]:     </video>
Oct 20 17:05:04 user nova-compute[74131]:     <rng model="virtio">
Oct 20 17:05:04 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 17:05:04 user nova-compute[74131]:     </rng>
Oct 20 17:05:04 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 17:05:04 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 17:05:04 user nova-compute[74131]:       <stats period="10"/>
Oct 20 17:05:04 user nova-compute[74131]:     </memballoon>
Oct 20 17:05:04 user nova-compute[74131]:   </devices>
Oct 20 17:05:04 user nova-compute[74131]: </domain>
Oct 20 17:05:04 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-465589598',display_name='tempest-TestMinimumBasicScenario-server-465589598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-465589598',id=51,image_ref='103f1771-1883-4392-8196-6bb6fb365c20',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeGH4Y7+DE4RXUbT5FYVixgAJLrxdhuAHlpsjXK4rMW17AoWICAapwjeV30lSQH8cluVfFdVgYjLFWOD0E96YUlN1kTVrfBIV1284XiXO8Ia3pyPxyNQGw+Kvz6AZEyZw==',key_name='tempest-TestMinimumBasicScenario-650530573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-vvgm0xxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='103f1771-1883-4392-8196-6bb6fb365c20',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T17:05:02Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=3fcd40ec-491e-4fee-9326-a650a6d29bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:37,bridge_name='br-int',has_traffic_filtering=True,id=a050dcc3-0f4d-45a8-be55-43146dc85d9d,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa050dcc3-0f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG os_vif [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:37,bridge_name='br-int',has_traffic_filtering=True,id=a050dcc3-0f4d-45a8-be55-43146dc85d9d,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa050dcc3-0f') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0e1b87e5-67b7-488b-85c3-0c7ffc6fa87b req-ebe99f72-f937-4190-9839-33131876bf5e service nova] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f621f9e9-a626-5fa8-ae38-49af9d376507', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa050dcc3-0f, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa050dcc3-0f, col_values=(('qos', UUID('8823b35e-fe60-4f87-9324-f290f342692e')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa050dcc3-0f, col_values=(('external_ids', {'iface-id': 'a050dcc3-0f4d-45a8-be55-43146dc85d9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:93:37', 'vm-uuid': '3fcd40ec-491e-4fee-9326-a650a6d29bbe'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:04 user nova-compute[74131]: INFO os_vif [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:37,bridge_name='br-int',has_traffic_filtering=True,id=a050dcc3-0f4d-45a8-be55-43146dc85d9d,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa050dcc3-0f')
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:05:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No VIF found with MAC fa:16:3e:db:93:37, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-9a651827-ebd8-431f-a42b-9d28442c04e3 req-b3f1e5f1-723b-4d5a-ba20-db90ad00bb81 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9a651827-ebd8-431f-a42b-9d28442c04e3 req-b3f1e5f1-723b-4d5a-ba20-db90ad00bb81 service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9a651827-ebd8-431f-a42b-9d28442c04e3 req-b3f1e5f1-723b-4d5a-ba20-db90ad00bb81 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-9a651827-ebd8-431f-a42b-9d28442c04e3 req-b3f1e5f1-723b-4d5a-ba20-db90ad00bb81 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-9a651827-ebd8-431f-a42b-9d28442c04e3 req-b3f1e5f1-723b-4d5a-ba20-db90ad00bb81 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:05:06 user nova-compute[74131]: WARNING nova.compute.manager [req-9a651827-ebd8-431f-a42b-9d28442c04e3 req-b3f1e5f1-723b-4d5a-ba20-db90ad00bb81 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received unexpected event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with vm_state building and task_state spawning.
Oct 20 17:05:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 17:05:08 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance spawned successfully.
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:05:08 user nova-compute[74131]: INFO nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Took 6.00 seconds to spawn the instance on the hypervisor.
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-f3b6f8c0-1748-4256-bd35-f2fa2370e012 req-8aa899aa-542b-42d9-8d7c-4474711f9a12 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f3b6f8c0-1748-4256-bd35-f2fa2370e012 req-8aa899aa-542b-42d9-8d7c-4474711f9a12 service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f3b6f8c0-1748-4256-bd35-f2fa2370e012 req-8aa899aa-542b-42d9-8d7c-4474711f9a12 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-f3b6f8c0-1748-4256-bd35-f2fa2370e012 req-8aa899aa-542b-42d9-8d7c-4474711f9a12 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:08 user nova-compute[74131]: DEBUG nova.compute.manager [req-f3b6f8c0-1748-4256-bd35-f2fa2370e012 req-8aa899aa-542b-42d9-8d7c-4474711f9a12 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:05:08 user nova-compute[74131]: WARNING nova.compute.manager [req-f3b6f8c0-1748-4256-bd35-f2fa2370e012 req-8aa899aa-542b-42d9-8d7c-4474711f9a12 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received unexpected event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with vm_state building and task_state spawning.
Oct 20 17:05:08 user nova-compute[74131]: INFO nova.compute.manager [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Took 6.85 seconds to build instance.
Oct 20 17:05:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-6379ee6f-e863-412b-91c1-a6c0c6dec93c tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.967s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:05:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:05:46 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 17:05:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 17:05:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:55 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:05:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:56 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 17:05:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:58 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:05:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:05:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:05:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:05:58 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:05:58 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:05:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:06:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:06:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:06:02 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:06:02 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:06:03 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:06:03 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.982746124267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:06:03 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:06:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:06:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:06:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:18 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 17:06:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:06:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:06:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:06:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:06:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:06:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:06:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:06:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:06:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:06:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:06:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:06:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:06:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:06:49 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:56 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG nova.objects.instance [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'flavor' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:06:57 user nova-compute[74131]: INFO nova.compute.manager [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Attaching volume d008bef0-4401-4e23-bb66-e2505c91d943 to /dev/vdb
Oct 20 17:06:57 user nova-compute[74131]: DEBUG os_brick.utils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db47fd7-49f8-42cf-b4da-10dad21d7fc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd3cd41-2c75-44aa-895e-d235bde9463d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f329e8-8d1b-4b4b-b70c-752a1c325a9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf1c7f1-d7a3-4c43-b7c5-82ee887e6ff9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:06:57 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:06:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e223da0-0280-46c9-a60f-2b8f87e4bbd2]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG os_brick.utils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:06:57 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating existing volume attachment record: 11fd82e2-b54a-418d-bc6f-eaa76d81d68f {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:06:59 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:07:00 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:07:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:07:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:07:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:07:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:07:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:07:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:07:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:07:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=24.98200225830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:07:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:07:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:07:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:07:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:07:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:07:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:07:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4995-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:07:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:07:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:07:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:07:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRSIMjml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:07:22 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:07:22 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:07:22 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e1326-a9fa-494e-a6a0-eaf6f92c1596]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:07:22 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7ea058-dd9a-4c10-b7a5-3ff24dcb62cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943] added
Oct 20 17:07:22 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b964d081-e050-4417-bc56-71017f0abc38]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d366fee-9f13-4115-8f00-53f65ec1cae8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRSIMjml {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRSIMjml" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[029b30c7-db3f-4044-ac45-5c112abc6312]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRSIMjml'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c8e9da-639c-41c0-abf8-f3301a116aee]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abe3621-e20e-4f2e-9c8c-1e6f694a22b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:07:22 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:07:22 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:07:22 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:07:22 user nova-compute[74131]: 
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae20b7f-fd2a-43fe-81c1-68d2bb51b1b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260]
Oct 20 17:07:22 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260] successful.
Oct 20 17:07:22 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24f59da-3257-4230-adc4-45cc56da6ef8]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af88321-5987-4593-abf0-b2e6c12659be]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 (non-flash)
Oct 20 17:07:22 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 (non-flash)
Oct 20 17:07:22 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0becdba-b8e6-4513-8bf8-6b8552d2abc9]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:07:22 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:07:23 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:07:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRSIMjml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:07:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:07:23 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26335316637663939', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:07:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335316637663939', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:07:23 user nova-compute[74131]: DEBUG nova.objects.instance [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'flavor' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:07:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:07:23 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:07:23 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:07:23 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:07:23 user nova-compute[74131]:   <serial>d008bef0-4401-4e23-bb66-e2505c91d943</serial>
Oct 20 17:07:23 user nova-compute[74131]: </disk>
Oct 20 17:07:23 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:07:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:07:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:07:24 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] No VIF found with MAC fa:16:3e:db:93:37, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:07:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-3a41b3cc-052e-45db-a5b5-a2a099a5ef27 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.762s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:07:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:07:27 user nova-compute[74131]: DEBUG nova.compute.manager [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing instance network info cache due to event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:07:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:07:27 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:07:27 user nova-compute[74131]: DEBUG nova.network.neutron [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:07:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated VIF entry in instance network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:07:28 user nova-compute[74131]: DEBUG nova.network.neutron [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:07:28 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fbf21534-0608-4f5d-a78e-4a5c96b616ff req-27d30509-9ae7-400d-b595-c59f617edebe service nova] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG nova.compute.manager [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing instance network info cache due to event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated VIF entry in instance network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG nova.network.neutron [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a891f288-21f5-4b46-bc52-77c830c48054 req-00aa06ea-4d81-46b9-9b7a-58dc1d737439 service nova] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:07:29 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:07:29 user nova-compute[74131]: INFO nova.compute.manager [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Rebooting instance
Oct 20 17:07:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:07:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:07:30 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 17:07:30 user nova-compute[74131]: DEBUG nova.network.neutron [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:07:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:07:30 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 17:07:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-680edf11-0553-487d-90e9-ceeaa74391a4 req-cfa110ba-9034-47b8-ae83-f9bfc7f837fa service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-unplugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-680edf11-0553-487d-90e9-ceeaa74391a4 req-cfa110ba-9034-47b8-ae83-f9bfc7f837fa service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-680edf11-0553-487d-90e9-ceeaa74391a4 req-cfa110ba-9034-47b8-ae83-f9bfc7f837fa service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-680edf11-0553-487d-90e9-ceeaa74391a4 req-cfa110ba-9034-47b8-ae83-f9bfc7f837fa service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-680edf11-0553-487d-90e9-ceeaa74391a4 req-cfa110ba-9034-47b8-ae83-f9bfc7f837fa service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-unplugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:07:32 user nova-compute[74131]: WARNING nova.compute.manager [req-680edf11-0553-487d-90e9-ceeaa74391a4 req-cfa110ba-9034-47b8-ae83-f9bfc7f837fa service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received unexpected event network-vif-unplugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with vm_state active and task_state reboot_started.
Oct 20 17:07:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance shutdown successfully.
Oct 20 17:07:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-68a03554-f504-4e3b-bc02-80a405a842b3 req-3d76b0ad-2022-494e-afd5-9522327e10bf service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-68a03554-f504-4e3b-bc02-80a405a842b3 req-3d76b0ad-2022-494e-afd5-9522327e10bf service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-68a03554-f504-4e3b-bc02-80a405a842b3 req-3d76b0ad-2022-494e-afd5-9522327e10bf service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-68a03554-f504-4e3b-bc02-80a405a842b3 req-3d76b0ad-2022-494e-afd5-9522327e10bf service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-68a03554-f504-4e3b-bc02-80a405a842b3 req-3d76b0ad-2022-494e-afd5-9522327e10bf service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:07:34 user nova-compute[74131]: WARNING nova.compute.manager [req-68a03554-f504-4e3b-bc02-80a405a842b3 req-3d76b0ad-2022-494e-afd5-9522327e10bf service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received unexpected event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with vm_state active and task_state reboot_started.
Oct 20 17:07:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance running successfully.
Oct 20 17:07:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance soft rebooted successfully.
Oct 20 17:07:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:07:36 user nova-compute[74131]: WARNING nova.compute.manager [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received unexpected event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with vm_state active and task_state reboot_started.
Oct 20 17:07:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:36 user nova-compute[74131]: DEBUG nova.compute.manager [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:07:36 user nova-compute[74131]: WARNING nova.compute.manager [req-585b4103-d275-403f-9aa9-1c351d7a13cc req-4173c85a-1bdd-40e6-82b9-27cc057b4fa2 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received unexpected event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with vm_state active and task_state reboot_started.
Oct 20 17:07:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-b51cc088-9dd9-4002-838c-b8657fdb1b7f tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.060s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:07:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:47 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:07:58 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:58 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:07:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:07:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:08:01 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:08:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:08:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:08:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:08:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:08:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:08:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:08:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:08:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:08:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:08:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.980083465576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:08:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:08:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:08:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:08:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:08:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:08:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:08:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:08:48 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:08:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:09:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:09:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:09:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:09:01 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:09:01 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:09:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:09:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:09:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:09:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:09:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:09:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:09:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:09:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:09:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:09:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=24.979549407958984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:09:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:09:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:09:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:09:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:09:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:09:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:09:21 user nova-compute[74131]: DEBUG nova.compute.manager [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing instance network info cache due to event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:09:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:09:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:09:21 user nova-compute[74131]: DEBUG nova.network.neutron [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:09:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated VIF entry in instance network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:09:22 user nova-compute[74131]: DEBUG nova.network.neutron [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:09:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-0d6c390f-fa3d-4085-8efd-de7f13be12a0 req-f5b57484-e435-452e-b78d-516b4f4f3b6a service nova] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:09:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:09:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:09:22 user nova-compute[74131]: INFO nova.compute.manager [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Detaching volume d008bef0-4401-4e23-bb66-e2505c91d943
Oct 20 17:09:22 user nova-compute[74131]: INFO nova.virt.block_device [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Attempting to driver detach volume d008bef0-4401-4e23-bb66-e2505c91d943 from mountpoint /dev/vdb
Oct 20 17:09:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Attempting to detach device vdb from instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:09:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:09:22 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:09:22 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:09:22 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:09:22 user nova-compute[74131]:   <serial>d008bef0-4401-4e23-bb66-e2505c91d943</serial>
Oct 20 17:09:22 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:09:22 user nova-compute[74131]: </disk>
Oct 20 17:09:22 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:09:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully detached device vdb from instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe from the persistent domain config.
Oct 20 17:09:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:09:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:09:22 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:09:22 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:09:22 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:09:22 user nova-compute[74131]:   <serial>d008bef0-4401-4e23-bb66-e2505c91d943</serial>
Oct 20 17:09:22 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:09:22 user nova-compute[74131]: </disk>
Oct 20 17:09:22 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:09:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:09:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:09:23 user nova-compute[74131]: DEBUG nova.compute.manager [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing instance network info cache due to event network-changed-a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:09:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:09:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:09:23 user nova-compute[74131]: DEBUG nova.network.neutron [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Refreshing network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:09:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated VIF entry in instance network info cache for port a050dcc3-0f4d-45a8-be55-43146dc85d9d. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:09:24 user nova-compute[74131]: DEBUG nova.network.neutron [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:09:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2d3d94fe-1ea9-4185-b584-f00a7b2ab73c req-a1ef41a4-2dc0-4405-9839-8457faa367a7 service nova] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:09:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:43 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe is timed out.
Oct 20 17:09:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully detached device vdb from instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe from the live domain config.
Oct 20 17:09:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRSIMjml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:09:43 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[44759c50-2c92-4017-8752-c7e46fd8d596]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:09:43 user nova-compute[74131]: No targets found.
Oct 20 17:09:43 user nova-compute[74131]: iSNS:
Oct 20 17:09:43 user nova-compute[74131]: No targets found.
Oct 20 17:09:43 user nova-compute[74131]: STATIC:
Oct 20 17:09:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943
Oct 20 17:09:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:09:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:09:43 user nova-compute[74131]: FIRMWARE:
Oct 20 17:09:43 user nova-compute[74131]: No targets found.
Oct 20 17:09:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:09:43 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:09:43 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc6ddbc-697f-40c2-905b-22176438cc93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a5316e-8ed4-41d4-b7f0-44e7b3e59803]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 (non-flash)
Oct 20 17:09:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 (non-flash)
Oct 20 17:09:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a8653a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2d0f4-18d8-4f22-b6a7-75d6b6580ceb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6f64b-f1a4-4b88-8847-28eb1f60ebc4]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8a57e6-5955-4b3b-a3fb-baa38b853cca]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73efbf-3855-4d03-993e-70d2419b3715]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c786b8-5ce3-4594-ba7b-b20b7b705ab0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad034e7-df86-4b9f-9add-dafec65d9e30]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260]
Oct 20 17:09:43 user nova-compute[74131]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943, portal: 172.16.0.220,3260] successful.
Oct 20 17:09:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d008bef0-4401-4e23-bb66-e2505c91d943 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d432ec-409c-4dc8-931e-9a029afcae10]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] <== disconnect_volume: return (262ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:09:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'flavor' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5837eab4-e072-42fa-8abc-a0072851e48b tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.928s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:09:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:09:50 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:51 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:09:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:09:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:10:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:00 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:10:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:10:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:10:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:10:01 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:10:01 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:10:01 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:10:02 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [{"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:10:02 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-3fcd40ec-491e-4fee-9326-a650a6d29bbe" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:10:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:10:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:10:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:10:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:10:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:10:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:10:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:10:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:10:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=24.97875213623047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:10:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:10:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:10:21 user nova-compute[74131]: INFO nova.compute.manager [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Terminating instance
Oct 20 17:10:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-5802fe93-07c2-4de2-8a30-f160b5780837 req-623902ac-fbd9-4fcc-973e-e081dba74b37 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-unplugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5802fe93-07c2-4de2-8a30-f160b5780837 req-623902ac-fbd9-4fcc-973e-e081dba74b37 service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5802fe93-07c2-4de2-8a30-f160b5780837 req-623902ac-fbd9-4fcc-973e-e081dba74b37 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-5802fe93-07c2-4de2-8a30-f160b5780837 req-623902ac-fbd9-4fcc-973e-e081dba74b37 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-5802fe93-07c2-4de2-8a30-f160b5780837 req-623902ac-fbd9-4fcc-973e-e081dba74b37 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-unplugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.compute.manager [req-5802fe93-07c2-4de2-8a30-f160b5780837 req-623902ac-fbd9-4fcc-973e-e081dba74b37 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-unplugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Instance destroyed successfully.
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.objects.instance [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lazy-loading 'resources' on Instance uuid 3fcd40ec-491e-4fee-9326-a650a6d29bbe {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-465589598',display_name='tempest-TestMinimumBasicScenario-server-465589598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-465589598',id=51,image_ref='103f1771-1883-4392-8196-6bb6fb365c20',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeGH4Y7+DE4RXUbT5FYVixgAJLrxdhuAHlpsjXK4rMW17AoWICAapwjeV30lSQH8cluVfFdVgYjLFWOD0E96YUlN1kTVrfBIV1284XiXO8Ia3pyPxyNQGw+Kvz6AZEyZw==',key_name='tempest-TestMinimumBasicScenario-650530573',keypairs=<?>,launch_index=0,launched_at=2023-10-20T17:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6696c177b72435da97dc1c1f8dd5fd6',ramdisk_id='',reservation_id='r-vvgm0xxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='103f1771-1883-4392-8196-6bb6fb365c20',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-61770447',owner_user_name='tempest-TestMinimumBasicScenario-61770447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T17:07:37Z,user_data=None,user_id='daee6058922b4b4a922cb42b0606adda',uuid=3fcd40ec-491e-4fee-9326-a650a6d29bbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converting VIF {"id": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "address": "fa:16:3e:db:93:37", "network": {"id": "11171cc2-ce47-4c7f-acaa-a8f2dc6d458f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1987087644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6696c177b72435da97dc1c1f8dd5fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa050dcc3-0f", "ovs_interfaceid": "a050dcc3-0f4d-45a8-be55-43146dc85d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:93:37,bridge_name='br-int',has_traffic_filtering=True,id=a050dcc3-0f4d-45a8-be55-43146dc85d9d,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa050dcc3-0f') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG os_vif [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:93:37,bridge_name='br-int',has_traffic_filtering=True,id=a050dcc3-0f4d-45a8-be55-43146dc85d9d,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa050dcc3-0f') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa050dcc3-0f, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8823b35e-fe60-4f87-9324-f290f342692e) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:10:22 user nova-compute[74131]: INFO os_vif [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:93:37,bridge_name='br-int',has_traffic_filtering=True,id=a050dcc3-0f4d-45a8-be55-43146dc85d9d,network=Network(11171cc2-ce47-4c7f-acaa-a8f2dc6d458f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa050dcc3-0f')
Oct 20 17:10:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Deleting instance files /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe_del
Oct 20 17:10:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Deletion of /opt/stack/data/nova/instances/3fcd40ec-491e-4fee-9326-a650a6d29bbe_del complete
Oct 20 17:10:22 user nova-compute[74131]: INFO nova.compute.manager [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 17:10:22 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 17:10:22 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 17:10:23 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:10:23 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Took 0.61 seconds to deallocate network for instance.
Oct 20 17:10:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:10:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:10:23 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:10:23 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:10:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:10:23 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Deleted allocations for instance 3fcd40ec-491e-4fee-9326-a650a6d29bbe
Oct 20 17:10:23 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-2aeaf8a6-5512-4411-bb19-3109a7555b53 tempest-TestMinimumBasicScenario-61770447 tempest-TestMinimumBasicScenario-61770447-project-member] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:10:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-e482553c-98fc-40db-a868-f106753dced7 req-b88a5c37-4e4b-46e9-be62-66ed2d265e29 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:10:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e482553c-98fc-40db-a868-f106753dced7 req-b88a5c37-4e4b-46e9-be62-66ed2d265e29 service nova] Acquiring lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:10:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e482553c-98fc-40db-a868-f106753dced7 req-b88a5c37-4e4b-46e9-be62-66ed2d265e29 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:10:24 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-e482553c-98fc-40db-a868-f106753dced7 req-b88a5c37-4e4b-46e9-be62-66ed2d265e29 service nova] Lock "3fcd40ec-491e-4fee-9326-a650a6d29bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:10:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-e482553c-98fc-40db-a868-f106753dced7 req-b88a5c37-4e4b-46e9-be62-66ed2d265e29 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] No waiting events found dispatching network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:10:24 user nova-compute[74131]: WARNING nova.compute.manager [req-e482553c-98fc-40db-a868-f106753dced7 req-b88a5c37-4e4b-46e9-be62-66ed2d265e29 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received unexpected event network-vif-plugged-a050dcc3-0f4d-45a8-be55-43146dc85d9d for instance with vm_state deleted and task_state None.
Oct 20 17:10:24 user nova-compute[74131]: DEBUG nova.compute.manager [req-e482553c-98fc-40db-a868-f106753dced7 req-b88a5c37-4e4b-46e9-be62-66ed2d265e29 service nova] [instance: 3fcd40ec-491e-4fee-9326-a650a6d29bbe] Received event network-vif-deleted-a050dcc3-0f4d-45a8-be55-43146dc85d9d {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:10:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:10:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:10:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:10:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:10:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:10:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:10:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:10:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:10:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:10:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:10:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 17:10:54 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 17:10:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:10:58 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:11:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:11:01 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 17:11:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:11:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:11:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:11:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=25.006118774414062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:11:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 17:11:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:11:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:11:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:11:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:11:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:11:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:11:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:11:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:11:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:11:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:11:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 17:11:35 user nova-compute[74131]: INFO nova.compute.claims [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Claim successful on node user
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.network.neutron [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 17:11:35 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 17:11:35 user nova-compute[74131]: DEBUG nova.policy [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4e9ac5c3a7b4ee88b891d4d5e735ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b42c8cd9304a258bc89ff224162de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 17:11:36 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Creating image(s)
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "/opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "/opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "/opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk 1073741824" returned: 0 in 0.059s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG nova.network.neutron [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Successfully created port: b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Cannot resize image /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Ensure instance console log exists: /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:36 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Successfully updated port: b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-changed-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.compute.manager [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Refreshing instance network info cache due to event network-changed-b598ec11-64de-49ee-8efd-9e235235d422. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.neutron [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Instance network_info: |[{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.neutron [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Refreshing network info cache for port b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Start _get_guest_xml network_info=[{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 17:11:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:11:37 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-916658849',display_name='tempest-SnapshotDataIntegrityTests-server-916658849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-916658849',id=52,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBON4wbmixwGkPqHAMc1nrvz8RhpVw4QFFrSpbVmKhOPW1WOFauhg6tLjmvyB4lEOeWqjC1Ui6phq/lTiNav7KVCdM1itehH6WzWTBUXz/epfsldCn4ji7ilmI2SrXUvEFg==',key_name='tempest-keypair-141732209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01b42c8cd9304a258bc89ff224162de2',ramdisk_id='',reservation_id='r-xkd50qa6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-870848453',owner_user_name='tempest-SnapshotDataIntegrityTests-870848453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T17:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9ac5c3a7b4ee88b891d4d5e735ff3',uuid=25984aea-f497-49f2-afb8-b841f56f15dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Converting VIF {"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ea:0e,bridge_name='br-int',has_traffic_filtering=True,id=b598ec11-64de-49ee-8efd-9e235235d422,network=Network(8ffcdf86-221f-43f3-adef-486b83b16377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598ec11-64') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.objects.instance [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'pci_devices' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 17:11:37 user nova-compute[74131]:   <uuid>25984aea-f497-49f2-afb8-b841f56f15dc</uuid>
Oct 20 17:11:37 user nova-compute[74131]:   <name>instance-00000034</name>
Oct 20 17:11:37 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 17:11:37 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 17:11:37 user nova-compute[74131]:   <metadata>
Oct 20 17:11:37 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 17:11:37 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 17:11:37 user nova-compute[74131]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-916658849</nova:name>
Oct 20 17:11:37 user nova-compute[74131]:       <nova:creationTime>2023-10-20 17:11:37</nova:creationTime>
Oct 20 17:11:37 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 17:11:37 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 17:11:37 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 17:11:37 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 17:11:37 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 17:11:37 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 17:11:37 user nova-compute[74131]:       </nova:flavor>
Oct 20 17:11:37 user nova-compute[74131]:       <nova:owner>
Oct 20 17:11:37 user nova-compute[74131]:         <nova:user uuid="a4e9ac5c3a7b4ee88b891d4d5e735ff3">tempest-SnapshotDataIntegrityTests-870848453-project-member</nova:user>
Oct 20 17:11:37 user nova-compute[74131]:         <nova:project uuid="01b42c8cd9304a258bc89ff224162de2">tempest-SnapshotDataIntegrityTests-870848453</nova:project>
Oct 20 17:11:37 user nova-compute[74131]:       </nova:owner>
Oct 20 17:11:37 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 17:11:37 user nova-compute[74131]:       <nova:ports>
Oct 20 17:11:37 user nova-compute[74131]:         <nova:port uuid="b598ec11-64de-49ee-8efd-9e235235d422">
Oct 20 17:11:37 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 17:11:37 user nova-compute[74131]:         </nova:port>
Oct 20 17:11:37 user nova-compute[74131]:       </nova:ports>
Oct 20 17:11:37 user nova-compute[74131]:     </nova:instance>
Oct 20 17:11:37 user nova-compute[74131]:   </metadata>
Oct 20 17:11:37 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 17:11:37 user nova-compute[74131]:     <system>
Oct 20 17:11:37 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 17:11:37 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 17:11:37 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 17:11:37 user nova-compute[74131]:       <entry name="serial">25984aea-f497-49f2-afb8-b841f56f15dc</entry>
Oct 20 17:11:37 user nova-compute[74131]:       <entry name="uuid">25984aea-f497-49f2-afb8-b841f56f15dc</entry>
Oct 20 17:11:37 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 17:11:37 user nova-compute[74131]:     </system>
Oct 20 17:11:37 user nova-compute[74131]:   </sysinfo>
Oct 20 17:11:37 user nova-compute[74131]:   <os>
Oct 20 17:11:37 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 17:11:37 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 17:11:37 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 17:11:37 user nova-compute[74131]:   </os>
Oct 20 17:11:37 user nova-compute[74131]:   <features>
Oct 20 17:11:37 user nova-compute[74131]:     <acpi/>
Oct 20 17:11:37 user nova-compute[74131]:     <apic/>
Oct 20 17:11:37 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 17:11:37 user nova-compute[74131]:   </features>
Oct 20 17:11:37 user nova-compute[74131]:   <clock offset="utc">
Oct 20 17:11:37 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 17:11:37 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 17:11:37 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 17:11:37 user nova-compute[74131]:   </clock>
Oct 20 17:11:37 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 17:11:37 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 17:11:37 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 17:11:37 user nova-compute[74131]:   </cpu>
Oct 20 17:11:37 user nova-compute[74131]:   <devices>
Oct 20 17:11:37 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 17:11:37 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 17:11:37 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk"/>
Oct 20 17:11:37 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 17:11:37 user nova-compute[74131]:     </disk>
Oct 20 17:11:37 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 17:11:37 user nova-compute[74131]:       <mac address="fa:16:3e:d3:ea:0e"/>
Oct 20 17:11:37 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:11:37 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 17:11:37 user nova-compute[74131]:       <target dev="tapb598ec11-64"/>
Oct 20 17:11:37 user nova-compute[74131]:     </interface>
Oct 20 17:11:37 user nova-compute[74131]:     <serial type="pty">
Oct 20 17:11:37 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/console.log" append="off"/>
Oct 20 17:11:37 user nova-compute[74131]:     </serial>
Oct 20 17:11:37 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 17:11:37 user nova-compute[74131]:     <video>
Oct 20 17:11:37 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:11:37 user nova-compute[74131]:     </video>
Oct 20 17:11:37 user nova-compute[74131]:     <rng model="virtio">
Oct 20 17:11:37 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 17:11:37 user nova-compute[74131]:     </rng>
Oct 20 17:11:37 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 17:11:37 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 17:11:37 user nova-compute[74131]:       <stats period="10"/>
Oct 20 17:11:37 user nova-compute[74131]:     </memballoon>
Oct 20 17:11:37 user nova-compute[74131]:   </devices>
Oct 20 17:11:37 user nova-compute[74131]: </domain>
Oct 20 17:11:37 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-916658849',display_name='tempest-SnapshotDataIntegrityTests-server-916658849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-916658849',id=52,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBON4wbmixwGkPqHAMc1nrvz8RhpVw4QFFrSpbVmKhOPW1WOFauhg6tLjmvyB4lEOeWqjC1Ui6phq/lTiNav7KVCdM1itehH6WzWTBUXz/epfsldCn4ji7ilmI2SrXUvEFg==',key_name='tempest-keypair-141732209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01b42c8cd9304a258bc89ff224162de2',ramdisk_id='',reservation_id='r-xkd50qa6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-870848453',owner_user_name='tempest-SnapshotDataIntegrityTests-870848453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T17:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9ac5c3a7b4ee88b891d4d5e735ff3',uuid=25984aea-f497-49f2-afb8-b841f56f15dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Converting VIF {"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ea:0e,bridge_name='br-int',has_traffic_filtering=True,id=b598ec11-64de-49ee-8efd-9e235235d422,network=Network(8ffcdf86-221f-43f3-adef-486b83b16377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598ec11-64') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG os_vif [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ea:0e,bridge_name='br-int',has_traffic_filtering=True,id=b598ec11-64de-49ee-8efd-9e235235d422,network=Network(8ffcdf86-221f-43f3-adef-486b83b16377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598ec11-64') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecef73a9-9d32-5e83-881d-a733a57738af', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb598ec11-64, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb598ec11-64, col_values=(('qos', UUID('104fd918-e5ba-41ab-b895-a44e92db7c4d')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb598ec11-64, col_values=(('external_ids', {'iface-id': 'b598ec11-64de-49ee-8efd-9e235235d422', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ea:0e', 'vm-uuid': '25984aea-f497-49f2-afb8-b841f56f15dc'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:37 user nova-compute[74131]: INFO os_vif [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ea:0e,bridge_name='br-int',has_traffic_filtering=True,id=b598ec11-64de-49ee-8efd-9e235235d422,network=Network(8ffcdf86-221f-43f3-adef-486b83b16377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598ec11-64')
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:11:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No VIF found with MAC fa:16:3e:d3:ea:0e, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:11:38 user nova-compute[74131]: DEBUG nova.network.neutron [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated VIF entry in instance network info cache for port b598ec11-64de-49ee-8efd-9e235235d422. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:11:38 user nova-compute[74131]: DEBUG nova.network.neutron [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:11:38 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-3d898668-4010-4ae0-be33-e99dbc102224 req-ebcd8245-7365-46d9-957c-507c357d4704 service nova] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-c2c72e70-15bc-4d67-a30a-25f1283a8c58 req-1be30dbf-318b-4c97-8e64-71087f8db007 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c2c72e70-15bc-4d67-a30a-25f1283a8c58 req-1be30dbf-318b-4c97-8e64-71087f8db007 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c2c72e70-15bc-4d67-a30a-25f1283a8c58 req-1be30dbf-318b-4c97-8e64-71087f8db007 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-c2c72e70-15bc-4d67-a30a-25f1283a8c58 req-1be30dbf-318b-4c97-8e64-71087f8db007 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG nova.compute.manager [req-c2c72e70-15bc-4d67-a30a-25f1283a8c58 req-1be30dbf-318b-4c97-8e64-71087f8db007 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:11:39 user nova-compute[74131]: WARNING nova.compute.manager [req-c2c72e70-15bc-4d67-a30a-25f1283a8c58 req-1be30dbf-318b-4c97-8e64-71087f8db007 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received unexpected event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with vm_state building and task_state spawning.
Oct 20 17:11:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 17:11:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Instance spawned successfully.
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:11:41 user nova-compute[74131]: INFO nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b78fa0e-ae9b-4c2b-87c9-43e827e7d386 req-1b880346-0561-4113-815b-6dbcacf48714 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b78fa0e-ae9b-4c2b-87c9-43e827e7d386 req-1b880346-0561-4113-815b-6dbcacf48714 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b78fa0e-ae9b-4c2b-87c9-43e827e7d386 req-1b880346-0561-4113-815b-6dbcacf48714 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b78fa0e-ae9b-4c2b-87c9-43e827e7d386 req-1b880346-0561-4113-815b-6dbcacf48714 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:41 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b78fa0e-ae9b-4c2b-87c9-43e827e7d386 req-1b880346-0561-4113-815b-6dbcacf48714 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:11:41 user nova-compute[74131]: WARNING nova.compute.manager [req-2b78fa0e-ae9b-4c2b-87c9-43e827e7d386 req-1b880346-0561-4113-815b-6dbcacf48714 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received unexpected event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with vm_state building and task_state spawning.
Oct 20 17:11:41 user nova-compute[74131]: INFO nova.compute.manager [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Took 6.05 seconds to build instance.
Oct 20 17:11:41 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-669051d0-7dcb-444a-a1e7-2f602a9728f8 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.147s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:11:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:52 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:54 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:11:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:11:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:02 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:12:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:12:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:12:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:12:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:12:03 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:12:03 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:12:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:12:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:12:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:12:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.00851821899414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:12:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:12:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:12:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:12:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:12:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:12:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:12:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:12:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:12:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:12:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:12:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:12:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:12:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:12:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:13:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:13:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:13:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:13:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:13:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:13:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:13:03 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:13:04 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:13:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.006572723388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:13:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:13:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:13:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:13:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-changed-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG nova.compute.manager [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Refreshing instance network info cache due to event network-changed-b598ec11-64de-49ee-8efd-9e235235d422. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Refreshing network info cache for port b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated VIF entry in instance network info cache for port b598ec11-64de-49ee-8efd-9e235235d422. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG nova.network.neutron [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:13:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a4d07080-390d-4b04-8f97-7ea6d12dfce4 req-a1a1f3a7-2262-4eea-8c0b-30c2a912cdb8 service nova] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:13:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:13:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:13:32 user nova-compute[74131]: INFO nova.compute.manager [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attaching volume 4d2653fc-d055-4f38-b571-70a637fafc24 to /dev/vdb
Oct 20 17:13:32 user nova-compute[74131]: DEBUG os_brick.utils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ab4599-c8ca-4fed-a8db-4a3d99353df0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[776d3d02-e16f-4bee-aa3a-5154e9f68c84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e1930e-8e6b-41b6-9760-e35c25b737d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d4adf4-a823-4716-a736-ac4e830cedc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:13:32 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:13:32 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef195f-1c71-45b1-bcaa-d6aa75fab829]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG os_brick.utils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating existing volume attachment record: 589ced1e-d7ce-49f0-8762-5e5f57fa3783 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:13:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:13:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:13:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:13:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:13:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBRcNval', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:13:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:13:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:13:48 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1647f8b-b5c6-4321-a6ec-14d0f1c12e3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:13:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795a10c-cc01-49f5-94fb-1c7a3304a965]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24] added
Oct 20 17:13:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d589f-1b0f-48ee-942c-2c9a2b5f8d8b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fee3806-5cc2-46f9-9fce-8e2e0610e5dd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kBRcNval {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kBRcNval" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb53518-a248-46dd-8da3-ebca7642e3fd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kBRcNval'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca703763-38bc-4d72-b740-2d0015b54c8a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[230573d1-c3f0-415c-8e2d-4853e8526977]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:13:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:13:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:13:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:13:48 user nova-compute[74131]: 
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[393404cc-1ebd-41e2-93b7-aa1c432d8192]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260]
Oct 20 17:13:48 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260] successful.
Oct 20 17:13:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e48659-2e4f-4c50-a514-017f4cc9bdab]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[215c2230-21af-4d06-9153-cbde51fc9681]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 (non-flash)
Oct 20 17:13:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 (non-flash)
Oct 20 17:13:48 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f97686f-46da-4699-b884-2a737a98b2ae]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:13:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBRcNval', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '26236636136323666', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236636136323666', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG nova.objects.instance [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:13:49 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:13:49 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:13:49 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:13:49 user nova-compute[74131]:   <serial>4d2653fc-d055-4f38-b571-70a637fafc24</serial>
Oct 20 17:13:49 user nova-compute[74131]: </disk>
Oct 20 17:13:49 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No VIF found with MAC fa:16:3e:d3:ea:0e, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:13:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-5e4667f7-f0ee-49dd-aff4-5b59d18b4ec6 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.557s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:13:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:53 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:13:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:13:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:14:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:14:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:14:05 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.00533676147461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:14:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:14:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:14:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:14:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:14:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:14:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:14:22 user nova-compute[74131]: INFO nova.compute.manager [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Detaching volume 4d2653fc-d055-4f38-b571-70a637fafc24
Oct 20 17:14:22 user nova-compute[74131]: INFO nova.virt.block_device [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attempting to driver detach volume 4d2653fc-d055-4f38-b571-70a637fafc24 from mountpoint /dev/vdb
Oct 20 17:14:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Attempting to detach device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:14:22 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:14:22 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:14:22 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:14:22 user nova-compute[74131]:   <serial>4d2653fc-d055-4f38-b571-70a637fafc24</serial>
Oct 20 17:14:22 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:14:22 user nova-compute[74131]: </disk>
Oct 20 17:14:22 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:14:22 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config.
Oct 20 17:14:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:14:22 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:14:22 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:14:22 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:14:22 user nova-compute[74131]:   <serial>4d2653fc-d055-4f38-b571-70a637fafc24</serial>
Oct 20 17:14:22 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:14:22 user nova-compute[74131]: </disk>
Oct 20 17:14:22 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:14:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:23 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:14:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:14:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:14:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:43 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc is timed out.
Oct 20 17:14:43 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config.
Oct 20 17:14:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBRcNval', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:14:43 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef43eb6-6ca6-411b-b412-5e95a2fcee46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:14:43 user nova-compute[74131]: No targets found.
Oct 20 17:14:43 user nova-compute[74131]: iSNS:
Oct 20 17:14:43 user nova-compute[74131]: No targets found.
Oct 20 17:14:43 user nova-compute[74131]: STATIC:
Oct 20 17:14:43 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24
Oct 20 17:14:43 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:14:43 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:14:43 user nova-compute[74131]: FIRMWARE:
Oct 20 17:14:43 user nova-compute[74131]: No targets found.
Oct 20 17:14:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:14:43 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:14:43 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b13e9-398d-44c9-a7aa-944106d4b70a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d08d8c3-fdc0-40ef-b62c-6c5013043509]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 (non-flash)
Oct 20 17:14:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 (non-flash)
Oct 20 17:14:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a85db910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a2ce70-e68f-46c2-bab4-131de90c65ae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[420cb1e8-0b00-41a5-b3bb-a81babc45ce6]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[40784c35-307a-4af4-8372-c79247513d13]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fd9b5-fd00-4864-87c3-dcd7ce6259a0]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f074f-9e4f-487e-af52-a83d35054516]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de958d9-f4cb-4362-84fe-495a492b77b8]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260]
Oct 20 17:14:43 user nova-compute[74131]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24, portal: 172.16.0.220,3260] successful.
Oct 20 17:14:43 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2653fc-d055-4f38-b571-70a637fafc24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[29288b72-9e11-4606-b3a3-d9d9636c5758]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== disconnect_volume: return (283ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:14:43 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:14:44 user nova-compute[74131]: DEBUG nova.objects.instance [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:14:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-caef46f0-30e1-4db1-8f87-0898e3f52538 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:14:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:14:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:14:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:14:55 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:14:58 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:14:58 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:15:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:05 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:15:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:15:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:15:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:15:06 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:15:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:07 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:15:07 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:15:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.004497528076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:15:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:15:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:15:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:15:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:15:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:15:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG nova.objects.instance [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:15:17 user nova-compute[74131]: INFO nova.compute.manager [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attaching volume a240735f-80b3-48c7-88fa-4c33c7b86519 to /dev/vdb
Oct 20 17:15:17 user nova-compute[74131]: DEBUG os_brick.utils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1817c1-dc60-4e99-823b-fecd936638cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c48fbc8-f898-46cc-a180-06a9ac132c3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a309bab-b7f8-4b62-a460-ec474432b263]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[240ca397-0388-4fca-ab84-f8c6d56c75bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:15:18 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:15:18 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[859a33c6-bfbe-42f0-ae5e-0f3d1619c5a2]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG os_brick.utils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:15:18 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating existing volume attachment record: 16c1631e-ef5c-4e97-b3e8-560096bafc33 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:15:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:15:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:15:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:15:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:15:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSKDJRGY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:15:33 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:15:33 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:15:33 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ded8736-07c1-4d8c-80e1-2d063e11084c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:15:33 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[47231e19-93ee-433c-a7cc-84a4e8cac24d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519] added
Oct 20 17:15:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd5317f-ae93-4134-817b-27f01788e631]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d250c51-fc6d-4be8-9bb9-9c2a819d2f3d]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSKDJRGY {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSKDJRGY" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f6457-0ce1-4062-8fd1-fb3882ebfcfd]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LSKDJRGY'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[748a2bd0-19f8-4b09-a091-bfaf7ac9282c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093cfce-48ab-4cde-9f16-006de7d174da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:15:33 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:15:33 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:15:33 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:15:33 user nova-compute[74131]: 
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6c298a-e440-4b6c-a146-035c3375300d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260]
Oct 20 17:15:33 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260] successful.
Oct 20 17:15:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1341ee80-3796-4794-8c97-94a63470f834]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e88346-70f8-4a33-9bbc-44268eafaf45]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 (non-flash)
Oct 20 17:15:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 (non-flash)
Oct 20 17:15:34 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3881dd1-a09f-405e-91cb-aa4680b26b81]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSKDJRGY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23866323566633066', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866323566633066', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG nova.objects.instance [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:15:35 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:15:35 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:15:35 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:15:35 user nova-compute[74131]:   <serial>a240735f-80b3-48c7-88fa-4c33c7b86519</serial>
Oct 20 17:15:35 user nova-compute[74131]: </disk>
Oct 20 17:15:35 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No VIF found with MAC fa:16:3e:d3:ea:0e, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:15:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-04fb31d5-590e-41d1-aa97-99bc494f221b tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.723s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:15:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:15:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:15:37 user nova-compute[74131]: INFO nova.compute.manager [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Detaching volume a240735f-80b3-48c7-88fa-4c33c7b86519
Oct 20 17:15:37 user nova-compute[74131]: INFO nova.virt.block_device [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attempting to driver detach volume a240735f-80b3-48c7-88fa-4c33c7b86519 from mountpoint /dev/vdb
Oct 20 17:15:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Attempting to detach device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:15:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:15:37 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:15:37 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:15:37 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:15:37 user nova-compute[74131]:   <serial>a240735f-80b3-48c7-88fa-4c33c7b86519</serial>
Oct 20 17:15:37 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:15:37 user nova-compute[74131]: </disk>
Oct 20 17:15:37 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:15:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config.
Oct 20 17:15:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:15:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:15:37 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:15:37 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:15:37 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:15:37 user nova-compute[74131]:   <serial>a240735f-80b3-48c7-88fa-4c33c7b86519</serial>
Oct 20 17:15:37 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:15:37 user nova-compute[74131]: </disk>
Oct 20 17:15:37 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:15:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:38 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:15:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:15:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:15:56 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:15:58 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc is timed out.
Oct 20 17:15:58 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config.
Oct 20 17:15:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSKDJRGY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:15:58 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5c8823-29a0-47c4-ba85-89c2c3bd3f09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:15:58 user nova-compute[74131]: No targets found.
Oct 20 17:15:58 user nova-compute[74131]: iSNS:
Oct 20 17:15:58 user nova-compute[74131]: No targets found.
Oct 20 17:15:58 user nova-compute[74131]: STATIC:
Oct 20 17:15:58 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519
Oct 20 17:15:58 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:15:58 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:15:58 user nova-compute[74131]: FIRMWARE:
Oct 20 17:15:58 user nova-compute[74131]: No targets found.
Oct 20 17:15:58 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:15:58 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:15:58 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cc6e66-9aad-4b1c-bca3-4e7ee4188a73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc000933-9320-49ab-bd15-dd80fb243ae9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 (non-flash)
Oct 20 17:15:58 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 (non-flash)
Oct 20 17:15:58 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c8716560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5c5ac-667e-4d87-a51d-82b02d804ab1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d7516-7ce4-45a4-ab2e-f5efc77d5e90]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd23f966-443b-4644-b0ab-187c19ad2e96]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c414044a-7467-465a-8b84-3df982bb2383]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5b3eaf-ddde-4169-88a6-716850429e8a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0626d0b4-7274-4a9e-825a-beaa852dc34f]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260]
Oct 20 17:15:58 user nova-compute[74131]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519, portal: 172.16.0.220,3260] successful.
Oct 20 17:15:58 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240735f-80b3-48c7-88fa-4c33c7b86519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422838b-67db-47b9-9756-2fbff55c0d90]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== disconnect_volume: return (323ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:15:58 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:15:59 user nova-compute[74131]: DEBUG nova.objects.instance [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:15:59 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-096fddba-79ed-44a6-b1df-72b9479025cd tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:16:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 17:16:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:16:06 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:07 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:16:07 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.003456115722656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:16:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:16:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:16:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:16:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:16:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:16:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 17:16:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:16:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG nova.objects.instance [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.021s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:16:33 user nova-compute[74131]: INFO nova.compute.manager [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attaching volume 793c5a5b-3e3d-45c3-ad3b-3f11ac020120 to /dev/vdb
Oct 20 17:16:33 user nova-compute[74131]: DEBUG os_brick.utils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b7767-8d02-4f3d-97ed-1972b5aec82b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6fd63b-d27b-4b4e-8ae1-413705c306c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88b4c7-b317-446d-b4c6-d2bdb5f27c12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a227dc-200a-4a17-97af-13a4746176ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:16:33 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:16:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e514a80-69d7-4e55-81a4-85c37b4fe944]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG os_brick.utils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:16:33 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating existing volume attachment record: 6ac7a81b-bc7e-4b3e-a42d-8cd3cecab706 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:16:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fECeQNPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:16:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:16:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:16:48 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:16:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:16:48 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:16:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1ea5b-770a-414a-b68d-884f7bd6a5f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:16:48 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:48 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[737596e2-3ed4-429c-a654-cdc9218dd4ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120] added
Oct 20 17:16:49 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e42c1-fba4-44b8-a780-7d242711a9c1]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c41d230-c0e2-4f30-9bef-6c508031d154]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fECeQNPs {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fECeQNPs" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dbcf82-ddbe-4da9-915d-11f7cfb1a841]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fECeQNPs'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c98e43-0199-431c-a9db-ba0ce865a1da]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62df952-d090-4fd3-8137-81678f37a711]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:16:49 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:16:49 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:16:49 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:16:49 user nova-compute[74131]: 
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe20fcc-150f-47a8-a45a-a52fdec875b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260]
Oct 20 17:16:49 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260] successful.
Oct 20 17:16:49 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b785a70-f69d-4a5c-adaa-0c7cf83dfb74]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85861fb-412e-4d3f-b4c1-af3290705bb1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 (non-flash)
Oct 20 17:16:49 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 (non-flash)
Oct 20 17:16:49 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1388cd-881c-48e0-af0d-bae726c8a6d3]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:16:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fECeQNPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23163373865653963', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163373865653963', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG nova.objects.instance [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:16:50 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:16:50 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:16:50 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:16:50 user nova-compute[74131]:   <serial>793c5a5b-3e3d-45c3-ad3b-3f11ac020120</serial>
Oct 20 17:16:50 user nova-compute[74131]: </disk>
Oct 20 17:16:50 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No VIF found with MAC fa:16:3e:d3:ea:0e, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:16:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-03cbbdc9-6841-4908-a9c1-91114dee3554 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.545s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:16:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:16:53 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:16:53 user nova-compute[74131]: INFO nova.compute.manager [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Detaching volume 793c5a5b-3e3d-45c3-ad3b-3f11ac020120
Oct 20 17:16:53 user nova-compute[74131]: INFO nova.virt.block_device [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attempting to driver detach volume 793c5a5b-3e3d-45c3-ad3b-3f11ac020120 from mountpoint /dev/vdb
Oct 20 17:16:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Attempting to detach device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:16:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:16:53 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:16:53 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:16:53 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:16:53 user nova-compute[74131]:   <serial>793c5a5b-3e3d-45c3-ad3b-3f11ac020120</serial>
Oct 20 17:16:53 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:16:53 user nova-compute[74131]: </disk>
Oct 20 17:16:53 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:16:53 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config.
Oct 20 17:16:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:16:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:16:53 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:16:53 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:16:53 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:16:53 user nova-compute[74131]:   <serial>793c5a5b-3e3d-45c3-ad3b-3f11ac020120</serial>
Oct 20 17:16:53 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:16:53 user nova-compute[74131]: </disk>
Oct 20 17:16:53 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:16:53 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:16:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:57 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:16:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:16:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:17:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:06 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:17:08 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:09 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:17:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:17:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.002464294433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:17:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc is timed out.
Oct 20 17:17:13 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config.
Oct 20 17:17:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fECeQNPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:17:13 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a38887-f7ac-466a-a9f0-0901755c8731]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:17:13 user nova-compute[74131]: No targets found.
Oct 20 17:17:13 user nova-compute[74131]: iSNS:
Oct 20 17:17:13 user nova-compute[74131]: No targets found.
Oct 20 17:17:13 user nova-compute[74131]: STATIC:
Oct 20 17:17:13 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120
Oct 20 17:17:13 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:17:13 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:17:13 user nova-compute[74131]: FIRMWARE:
Oct 20 17:17:13 user nova-compute[74131]: No targets found.
Oct 20 17:17:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:17:13 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:17:13 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8a9e6b-c313-40ed-a832-f2573362e199]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[67efd092-efa7-45c0-804a-f5f292e9a507]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 (non-flash)
Oct 20 17:17:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 (non-flash)
Oct 20 17:17:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a85b1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d70f25c-2495-4364-b389-fe4f5c4033b4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c71a3e-bad3-48f8-afa5-b5af1015d1f7]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cfc3d8-0329-43dd-97a2-7f685496d593]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe24342-8330-467a-ac2a-4bec1f89789e]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b038f45a-9a76-441c-bbc4-12507df16e95]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b68760-4df6-4f21-b77a-2ca4803b80f8]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260]
Oct 20 17:17:13 user nova-compute[74131]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120, portal: 172.16.0.220,3260] successful.
Oct 20 17:17:13 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:793c5a5b-3e3d-45c3-ad3b-3f11ac020120 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a767a9-f31a-4453-b526-7e74db3c2d10]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== disconnect_volume: return (289ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:17:13 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:17:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:17:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-cf3e9b93-149e-45ca-85d7-2df8e74ba320 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.712s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:17:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:17:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:17:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:17:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:17:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:17:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:17:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:17:48 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:17:48 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:17:49 user nova-compute[74131]: INFO nova.compute.manager [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attaching volume b99859ec-062d-4c19-b043-c00cf5f94a64 to /dev/vdb
Oct 20 17:17:49 user nova-compute[74131]: DEBUG os_brick.utils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17177f-0e29-4df7-a89e-5a87eb9bef99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0152bbd-8efa-40e8-8c38-3eaa9ef77d56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3736c0-7647-4a1a-883f-82b86d93b103]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d64c9f-bf62-4642-a2f1-3d3826091ef8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:17:49 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:17:49 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc80135-42c8-4b8c-b1da-374114a687a5]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG os_brick.utils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:17:49 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating existing volume attachment record: 6c566cb1-f88e-4544-8ccb-9ad911db0268 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:17:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:17:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:17:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:17:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:17:59 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:18:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWswrpah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:18:05 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:18:05 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:18:05 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0d4793-844a-46e0-ad7e-2047bf09f4f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:18:05 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe2606e-eee2-485a-8b77-1fbd5207204a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64] added
Oct 20 17:18:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[07951ded-faa3-4279-acf3-b9e4ef9b033c]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdde321-6fb3-4637-9497-2c60a6687455]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWswrpah {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWswrpah" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82db391-a752-43d0-acff-09e933444a5e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CWswrpah'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c5e252-4b53-46d3-997d-fe60aecb241f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdaf326-5f84-4cfd-b2ec-97aab4b5c92c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:18:05 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:18:05 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:18:05 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:18:05 user nova-compute[74131]: 
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b61cc1-fd3b-46f3-9be6-169c7e4c86ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260]
Oct 20 17:18:05 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260] successful.
Oct 20 17:18:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[19042911-fc56-4578-93b9-dc32ef01d793]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf86587-b8d4-49f9-aa89-2fadc78adc0d]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 (non-flash)
Oct 20 17:18:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 (non-flash)
Oct 20 17:18:05 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7047760-2323-4908-8993-cb6f28607bcd]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:05 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWswrpah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23930376238633137', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930376238633137', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG nova.objects.instance [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:18:06 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:18:06 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:18:06 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:18:06 user nova-compute[74131]:   <serial>b99859ec-062d-4c19-b043-c00cf5f94a64</serial>
Oct 20 17:18:06 user nova-compute[74131]: </disk>
Oct 20 17:18:06 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:18:06 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] No VIF found with MAC fa:16:3e:d3:ea:0e, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:18:07 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-a19f7b30-b5ea-459f-a730-bf80b3872593 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.615s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:18:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:18:09 user nova-compute[74131]: INFO nova.compute.manager [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Detaching volume b99859ec-062d-4c19-b043-c00cf5f94a64
Oct 20 17:18:09 user nova-compute[74131]: INFO nova.virt.block_device [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Attempting to driver detach volume b99859ec-062d-4c19-b043-c00cf5f94a64 from mountpoint /dev/vdb
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Attempting to detach device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:18:09 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:18:09 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:18:09 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:18:09 user nova-compute[74131]:   <serial>b99859ec-062d-4c19-b043-c00cf5f94a64</serial>
Oct 20 17:18:09 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:18:09 user nova-compute[74131]: </disk>
Oct 20 17:18:09 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:18:09 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the persistent domain config.
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:18:09 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:18:09 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:18:09 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:18:09 user nova-compute[74131]:   <serial>b99859ec-062d-4c19-b043-c00cf5f94a64</serial>
Oct 20 17:18:09 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:18:09 user nova-compute[74131]: </disk>
Oct 20 17:18:09 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:18:09 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:18:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:11 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:18:11 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:18:11 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.001434326171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:18:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:18:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:18:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:29 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25984aea-f497-49f2-afb8-b841f56f15dc is timed out.
Oct 20 17:18:29 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully detached device vdb from instance 25984aea-f497-49f2-afb8-b841f56f15dc from the live domain config.
Oct 20 17:18:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWswrpah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:18:29 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[767fb129-1138-4aef-9eb0-7f8eb5e49f0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:18:29 user nova-compute[74131]: No targets found.
Oct 20 17:18:29 user nova-compute[74131]: iSNS:
Oct 20 17:18:29 user nova-compute[74131]: No targets found.
Oct 20 17:18:29 user nova-compute[74131]: STATIC:
Oct 20 17:18:29 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64
Oct 20 17:18:29 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:18:29 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:18:29 user nova-compute[74131]: FIRMWARE:
Oct 20 17:18:29 user nova-compute[74131]: No targets found.
Oct 20 17:18:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:18:29 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:18:29 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a0cbf0-513e-473e-86fd-ea1a6299faf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4210be2c-ef79-4076-8f2d-a54478ea2627]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 (non-flash)
Oct 20 17:18:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 (non-flash)
Oct 20 17:18:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a85b0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e4ca72-5f68-44bf-b49c-6b119e1daded]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[386d5aad-9017-4e96-b46e-b59b138e5d24]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac69e0d2-4eee-476f-a68e-d49285c608b0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[958b40cd-810d-4fac-a1c4-e43c1ef158b6]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88b6ceb-4290-494e-a879-da8bdf7bb05e]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7adea66-7ac8-4cb1-8813-9c5e064fc6f0]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260]
Oct 20 17:18:29 user nova-compute[74131]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64, portal: 172.16.0.220,3260] successful.
Oct 20 17:18:29 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99859ec-062d-4c19-b043-c00cf5f94a64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b1a6a1-ea12-4fc7-95d8-d0655595dafa]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] <== disconnect_volume: return (264ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:18:29 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:18:30 user nova-compute[74131]: DEBUG nova.objects.instance [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'flavor' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:18:30 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-e5d76ac8-b6bc-44ee-b906-7f6304bae9d2 tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.612s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:18:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:18:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:18:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:18:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:18:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:18:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:18:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:19:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:19:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:19:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:19:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:19:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:19:10 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:19:10 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:19:11 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [{"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:19:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-25984aea-f497-49f2-afb8-b841f56f15dc" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:19:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:19:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:19:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:19:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:19:12 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:19:12 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:19:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:19:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:19:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.000652313232422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 25984aea-f497-49f2-afb8-b841f56f15dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:19:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:19:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:19:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:19:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:19:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:19:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:19:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:03 user nova-compute[74131]: INFO nova.compute.manager [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Terminating instance
Oct 20 17:20:03 user nova-compute[74131]: DEBUG nova.compute.manager [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e2f3d23-35a9-4e43-b179-d5ad4350175a req-38f90793-9dd6-4c4f-86d5-5b8df03fd726 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-unplugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e2f3d23-35a9-4e43-b179-d5ad4350175a req-38f90793-9dd6-4c4f-86d5-5b8df03fd726 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e2f3d23-35a9-4e43-b179-d5ad4350175a req-38f90793-9dd6-4c4f-86d5-5b8df03fd726 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2e2f3d23-35a9-4e43-b179-d5ad4350175a req-38f90793-9dd6-4c4f-86d5-5b8df03fd726 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e2f3d23-35a9-4e43-b179-d5ad4350175a req-38f90793-9dd6-4c4f-86d5-5b8df03fd726 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-unplugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [req-2e2f3d23-35a9-4e43-b179-d5ad4350175a req-38f90793-9dd6-4c4f-86d5-5b8df03fd726 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-unplugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Instance destroyed successfully.
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.objects.instance [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lazy-loading 'resources' on Instance uuid 25984aea-f497-49f2-afb8-b841f56f15dc {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-916658849',display_name='tempest-SnapshotDataIntegrityTests-server-916658849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-916658849',id=52,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBON4wbmixwGkPqHAMc1nrvz8RhpVw4QFFrSpbVmKhOPW1WOFauhg6tLjmvyB4lEOeWqjC1Ui6phq/lTiNav7KVCdM1itehH6WzWTBUXz/epfsldCn4ji7ilmI2SrXUvEFg==',key_name='tempest-keypair-141732209',keypairs=<?>,launch_index=0,launched_at=2023-10-20T17:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01b42c8cd9304a258bc89ff224162de2',ramdisk_id='',reservation_id='r-xkd50qa6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-870848453',owner_user_name='tempest-SnapshotDataIntegrityTests-870848453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T17:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9ac5c3a7b4ee88b891d4d5e735ff3',uuid=25984aea-f497-49f2-afb8-b841f56f15dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Converting VIF {"id": "b598ec11-64de-49ee-8efd-9e235235d422", "address": "fa:16:3e:d3:ea:0e", "network": {"id": "8ffcdf86-221f-43f3-adef-486b83b16377", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1219503971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b42c8cd9304a258bc89ff224162de2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598ec11-64", "ovs_interfaceid": "b598ec11-64de-49ee-8efd-9e235235d422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ea:0e,bridge_name='br-int',has_traffic_filtering=True,id=b598ec11-64de-49ee-8efd-9e235235d422,network=Network(8ffcdf86-221f-43f3-adef-486b83b16377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598ec11-64') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG os_vif [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ea:0e,bridge_name='br-int',has_traffic_filtering=True,id=b598ec11-64de-49ee-8efd-9e235235d422,network=Network(8ffcdf86-221f-43f3-adef-486b83b16377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598ec11-64') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb598ec11-64, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=104fd918-e5ba-41ab-b895-a44e92db7c4d) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:04 user nova-compute[74131]: INFO os_vif [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ea:0e,bridge_name='br-int',has_traffic_filtering=True,id=b598ec11-64de-49ee-8efd-9e235235d422,network=Network(8ffcdf86-221f-43f3-adef-486b83b16377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598ec11-64')
Oct 20 17:20:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Deleting instance files /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc_del
Oct 20 17:20:04 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Deletion of /opt/stack/data/nova/instances/25984aea-f497-49f2-afb8-b841f56f15dc_del complete
Oct 20 17:20:04 user nova-compute[74131]: INFO nova.compute.manager [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 17:20:04 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:20:05 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Took 1.03 seconds to deallocate network for instance.
Oct 20 17:20:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG nova.compute.manager [req-6e3339e1-e1a0-44a4-af4f-9385690a59f4 req-616e99be-3e98-4191-a087-bdae84939e4e service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-deleted-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:05 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Deleted allocations for instance 25984aea-f497-49f2-afb8-b841f56f15dc
Oct 20 17:20:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-06e4c0b5-9768-41ea-8843-8bfa5552825d tempest-SnapshotDataIntegrityTests-870848453 tempest-SnapshotDataIntegrityTests-870848453-project-member] Lock "25984aea-f497-49f2-afb8-b841f56f15dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.211s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:20:06 user nova-compute[74131]: WARNING nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received unexpected event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with vm_state deleted and task_state None.
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:20:06 user nova-compute[74131]: WARNING nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received unexpected event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with vm_state deleted and task_state None.
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:20:06 user nova-compute[74131]: WARNING nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received unexpected event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with vm_state deleted and task_state None.
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-unplugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-unplugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:20:06 user nova-compute[74131]: WARNING nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received unexpected event network-vif-unplugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with vm_state deleted and task_state None.
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Acquiring lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] Lock "25984aea-f497-49f2-afb8-b841f56f15dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:06 user nova-compute[74131]: DEBUG nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] No waiting events found dispatching network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:20:06 user nova-compute[74131]: WARNING nova.compute.manager [req-37d4d014-6e3b-4b44-bd9a-dfbc6092d4ca req-34fc5b3f-d942-427b-a619-32212712d8e3 service nova] [instance: 25984aea-f497-49f2-afb8-b841f56f15dc] Received unexpected event network-vif-plugged-b598ec11-64de-49ee-8efd-9e235235d422 for instance with vm_state deleted and task_state None.
Oct 20 17:20:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:20:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:20:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:20:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 17:20:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:12 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:20:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:20:13 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9089MB free_disk=25.02762222290039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:20:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:20:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:20:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:20:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:20:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:20:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:20:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:20:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:20:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:54 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:20:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:20:59 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:00 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:00 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:03 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:04 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 17:21:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 17:21:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:08 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:21:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:21:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:21:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:21:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:21:09 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:21:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:21:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 17:21:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:21:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:21:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9173MB free_disk=25.012928009033203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:14 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:19 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:21:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:21:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 17:21:24 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:30 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:34 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:35 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:39 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Starting instance... {{(pid=74131) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74131) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 17:21:44 user nova-compute[74131]: INFO nova.compute.claims [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Claim successful on node user
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Start building networks asynchronously for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Allocating IP information in the background. {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.network.neutron [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] allocate_for_instance() {{(pid=74131) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 17:21:44 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Start building block device mappings for instance. {{(pid=74131) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 17:21:44 user nova-compute[74131]: DEBUG nova.policy [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f155e3b888b243caac6e6967fcbdbd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e44fc36c814cdb8ea6c71d781c06fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74131) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Start spawning the instance on the hypervisor. {{(pid=74131) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Creating instance directory {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 17:21:45 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Creating image(s)
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "/opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "/opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "/opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.221s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.212s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk 1073741824 {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e,backing_fmt=raw /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk 1073741824" returned: 0 in 0.061s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "71201ffb40ef43eaeab83d5041f5b38c691b569e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71201ffb40ef43eaeab83d5041f5b38c691b569e --force-share --output=json" returned: 0 in 0.206s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk. size=1073741824 {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG nova.virt.disk.api [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Cannot resize image /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk to a smaller size. {{(pid=74131) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Created local disks {{(pid=74131) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Ensure instance console log exists: /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/console.log {{(pid=74131) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Successfully created port: 871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Successfully updated port: 871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Building network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-changed-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG nova.compute.manager [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Refreshing instance network info cache due to event network-changed-871fb124-0e16-4855-bd8c-5844217ba9d4. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:21:46 user nova-compute[74131]: DEBUG nova.network.neutron [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Instance cache missing network info. {{(pid=74131) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.neutron [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Instance network_info: |[{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74131) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Refreshing network info cache for port 871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Start _get_guest_xml network_info=[{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '5632de9b-7b89-4624-9137-cb6ef38be112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 17:21:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:21:47 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CPU controller missing on host. {{(pid=74131) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.host [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CPU controller found on host. {{(pid=74131) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74131) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T16:15:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T16:15:35Z,direct_url=<?>,disk_format='qcow2',id=5632de9b-7b89-4624-9137-cb6ef38be112,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5889652fa55d4800a9bba1c85a9dcf68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T16:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Flavor limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Image limits 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Flavor pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Image pref 0:0:0 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Got 1 possible topologies {{(pid=74131) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.hardware [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74131) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-455108372',display_name='tempest-SnapshotDataIntegrityTests-server-455108372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-455108372',id=53,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwy7wkV2r1duEEVmC52fBsBrzsXopvdvhfICOlhNofFG5VNhQYpjCyrZr3r7Bcnn3ndbonwq3yS5elk91TBcdMqVJtVMgy2wFpu1i0zy6huaA2AaYmF7vT1hiwR11hvoA==',key_name='tempest-keypair-3662127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e44fc36c814cdb8ea6c71d781c06fa',ramdisk_id='',reservation_id='r-3d5or7b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-352806666',owner_user_name='tempest-SnapshotDataIntegrityTests-352806666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T17:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f155e3b888b243caac6e6967fcbdbd23',uuid=64ff9b13-0c66-4265-a5cd-7bc6c155c1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74131) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Converting VIF {"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:8b,bridge_name='br-int',has_traffic_filtering=True,id=871fb124-0e16-4855-bd8c-5844217ba9d4,network=Network(ce80a6d2-25c7-4432-a1d7-7e963fa28f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871fb124-0e') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'pci_devices' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 17:21:47 user nova-compute[74131]:   <uuid>64ff9b13-0c66-4265-a5cd-7bc6c155c1f4</uuid>
Oct 20 17:21:47 user nova-compute[74131]:   <name>instance-00000035</name>
Oct 20 17:21:47 user nova-compute[74131]:   <memory>524288</memory>
Oct 20 17:21:47 user nova-compute[74131]:   <vcpu>1</vcpu>
Oct 20 17:21:47 user nova-compute[74131]:   <metadata>
Oct 20 17:21:47 user nova-compute[74131]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 17:21:47 user nova-compute[74131]:       <nova:package version="0.0.0"/>
Oct 20 17:21:47 user nova-compute[74131]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-455108372</nova:name>
Oct 20 17:21:47 user nova-compute[74131]:       <nova:creationTime>2023-10-20 17:21:47</nova:creationTime>
Oct 20 17:21:47 user nova-compute[74131]:       <nova:flavor name="m1.tiny">
Oct 20 17:21:47 user nova-compute[74131]:         <nova:memory>512</nova:memory>
Oct 20 17:21:47 user nova-compute[74131]:         <nova:disk>1</nova:disk>
Oct 20 17:21:47 user nova-compute[74131]:         <nova:swap>0</nova:swap>
Oct 20 17:21:47 user nova-compute[74131]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 17:21:47 user nova-compute[74131]:         <nova:vcpus>1</nova:vcpus>
Oct 20 17:21:47 user nova-compute[74131]:       </nova:flavor>
Oct 20 17:21:47 user nova-compute[74131]:       <nova:owner>
Oct 20 17:21:47 user nova-compute[74131]:         <nova:user uuid="f155e3b888b243caac6e6967fcbdbd23">tempest-SnapshotDataIntegrityTests-352806666-project-member</nova:user>
Oct 20 17:21:47 user nova-compute[74131]:         <nova:project uuid="79e44fc36c814cdb8ea6c71d781c06fa">tempest-SnapshotDataIntegrityTests-352806666</nova:project>
Oct 20 17:21:47 user nova-compute[74131]:       </nova:owner>
Oct 20 17:21:47 user nova-compute[74131]:       <nova:root type="image" uuid="5632de9b-7b89-4624-9137-cb6ef38be112"/>
Oct 20 17:21:47 user nova-compute[74131]:       <nova:ports>
Oct 20 17:21:47 user nova-compute[74131]:         <nova:port uuid="871fb124-0e16-4855-bd8c-5844217ba9d4">
Oct 20 17:21:47 user nova-compute[74131]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 17:21:47 user nova-compute[74131]:         </nova:port>
Oct 20 17:21:47 user nova-compute[74131]:       </nova:ports>
Oct 20 17:21:47 user nova-compute[74131]:     </nova:instance>
Oct 20 17:21:47 user nova-compute[74131]:   </metadata>
Oct 20 17:21:47 user nova-compute[74131]:   <sysinfo type="smbios">
Oct 20 17:21:47 user nova-compute[74131]:     <system>
Oct 20 17:21:47 user nova-compute[74131]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 17:21:47 user nova-compute[74131]:       <entry name="product">OpenStack Nova</entry>
Oct 20 17:21:47 user nova-compute[74131]:       <entry name="version">0.0.0</entry>
Oct 20 17:21:47 user nova-compute[74131]:       <entry name="serial">64ff9b13-0c66-4265-a5cd-7bc6c155c1f4</entry>
Oct 20 17:21:47 user nova-compute[74131]:       <entry name="uuid">64ff9b13-0c66-4265-a5cd-7bc6c155c1f4</entry>
Oct 20 17:21:47 user nova-compute[74131]:       <entry name="family">Virtual Machine</entry>
Oct 20 17:21:47 user nova-compute[74131]:     </system>
Oct 20 17:21:47 user nova-compute[74131]:   </sysinfo>
Oct 20 17:21:47 user nova-compute[74131]:   <os>
Oct 20 17:21:47 user nova-compute[74131]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 17:21:47 user nova-compute[74131]:     <boot dev="hd"/>
Oct 20 17:21:47 user nova-compute[74131]:     <smbios mode="sysinfo"/>
Oct 20 17:21:47 user nova-compute[74131]:   </os>
Oct 20 17:21:47 user nova-compute[74131]:   <features>
Oct 20 17:21:47 user nova-compute[74131]:     <acpi/>
Oct 20 17:21:47 user nova-compute[74131]:     <apic/>
Oct 20 17:21:47 user nova-compute[74131]:     <vmcoreinfo/>
Oct 20 17:21:47 user nova-compute[74131]:   </features>
Oct 20 17:21:47 user nova-compute[74131]:   <clock offset="utc">
Oct 20 17:21:47 user nova-compute[74131]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 17:21:47 user nova-compute[74131]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 17:21:47 user nova-compute[74131]:     <timer name="hpet" present="no"/>
Oct 20 17:21:47 user nova-compute[74131]:   </clock>
Oct 20 17:21:47 user nova-compute[74131]:   <cpu mode="custom" match="exact">
Oct 20 17:21:47 user nova-compute[74131]:     <model>Nehalem</model>
Oct 20 17:21:47 user nova-compute[74131]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 17:21:47 user nova-compute[74131]:   </cpu>
Oct 20 17:21:47 user nova-compute[74131]:   <devices>
Oct 20 17:21:47 user nova-compute[74131]:     <disk type="file" device="disk">
Oct 20 17:21:47 user nova-compute[74131]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 17:21:47 user nova-compute[74131]:       <source file="/opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk"/>
Oct 20 17:21:47 user nova-compute[74131]:       <target dev="vda" bus="virtio"/>
Oct 20 17:21:47 user nova-compute[74131]:     </disk>
Oct 20 17:21:47 user nova-compute[74131]:     <interface type="ethernet">
Oct 20 17:21:47 user nova-compute[74131]:       <mac address="fa:16:3e:fe:42:8b"/>
Oct 20 17:21:47 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:21:47 user nova-compute[74131]:       <mtu size="1442"/>
Oct 20 17:21:47 user nova-compute[74131]:       <target dev="tap871fb124-0e"/>
Oct 20 17:21:47 user nova-compute[74131]:     </interface>
Oct 20 17:21:47 user nova-compute[74131]:     <serial type="pty">
Oct 20 17:21:47 user nova-compute[74131]:       <log file="/opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/console.log" append="off"/>
Oct 20 17:21:47 user nova-compute[74131]:     </serial>
Oct 20 17:21:47 user nova-compute[74131]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 17:21:47 user nova-compute[74131]:     <video>
Oct 20 17:21:47 user nova-compute[74131]:       <model type="virtio"/>
Oct 20 17:21:47 user nova-compute[74131]:     </video>
Oct 20 17:21:47 user nova-compute[74131]:     <rng model="virtio">
Oct 20 17:21:47 user nova-compute[74131]:       <backend model="random">/dev/urandom</backend>
Oct 20 17:21:47 user nova-compute[74131]:     </rng>
Oct 20 17:21:47 user nova-compute[74131]:     <controller type="usb" index="0" model="none"/>
Oct 20 17:21:47 user nova-compute[74131]:     <memballoon model="virtio">
Oct 20 17:21:47 user nova-compute[74131]:       <stats period="10"/>
Oct 20 17:21:47 user nova-compute[74131]:     </memballoon>
Oct 20 17:21:47 user nova-compute[74131]:   </devices>
Oct 20 17:21:47 user nova-compute[74131]: </domain>
Oct 20 17:21:47 user nova-compute[74131]:  {{(pid=74131) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-455108372',display_name='tempest-SnapshotDataIntegrityTests-server-455108372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-455108372',id=53,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwy7wkV2r1duEEVmC52fBsBrzsXopvdvhfICOlhNofFG5VNhQYpjCyrZr3r7Bcnn3ndbonwq3yS5elk91TBcdMqVJtVMgy2wFpu1i0zy6huaA2AaYmF7vT1hiwR11hvoA==',key_name='tempest-keypair-3662127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e44fc36c814cdb8ea6c71d781c06fa',ramdisk_id='',reservation_id='r-3d5or7b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-352806666',owner_user_name='tempest-SnapshotDataIntegrityTests-352806666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T17:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f155e3b888b243caac6e6967fcbdbd23',uuid=64ff9b13-0c66-4265-a5cd-7bc6c155c1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Converting VIF {"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:8b,bridge_name='br-int',has_traffic_filtering=True,id=871fb124-0e16-4855-bd8c-5844217ba9d4,network=Network(ce80a6d2-25c7-4432-a1d7-7e963fa28f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871fb124-0e') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG os_vif [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:8b,bridge_name='br-int',has_traffic_filtering=True,id=871fb124-0e16-4855-bd8c-5844217ba9d4,network=Network(ce80a6d2-25c7-4432-a1d7-7e963fa28f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871fb124-0e') {{(pid=74131) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98c6a41e-89c7-579a-a32f-d41872e69846', '_type': 'linux-noop'}}, row=False) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap871fb124-0e, may_exist=True, interface_attrs={}) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap871fb124-0e, col_values=(('qos', UUID('696f85be-4be2-4846-8420-01beb9617aa7')),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap871fb124-0e, col_values=(('external_ids', {'iface-id': '871fb124-0e16-4855-bd8c-5844217ba9d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:42:8b', 'vm-uuid': '64ff9b13-0c66-4265-a5cd-7bc6c155c1f4'}),), if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:47 user nova-compute[74131]: INFO os_vif [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:8b,bridge_name='br-int',has_traffic_filtering=True,id=871fb124-0e16-4855-bd8c-5844217ba9d4,network=Network(ce80a6d2-25c7-4432-a1d7-7e963fa28f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871fb124-0e')
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No VIF found with MAC fa:16:3e:fe:42:8b, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated VIF entry in instance network info cache for port 871fb124-0e16-4855-bd8c-5844217ba9d4. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG nova.network.neutron [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:21:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-af40a503-4262-4169-bf75-d63b06ffcb75 req-af6a42f2-ef61-4f4d-a0ba-2df4982db799 service nova] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-1375a453-8035-4a0b-bb86-17cb7b36ab3b req-0ce19225-b1e6-40b7-b297-c918166ab6e6 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1375a453-8035-4a0b-bb86-17cb7b36ab3b req-0ce19225-b1e6-40b7-b297-c918166ab6e6 service nova] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1375a453-8035-4a0b-bb86-17cb7b36ab3b req-0ce19225-b1e6-40b7-b297-c918166ab6e6 service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-1375a453-8035-4a0b-bb86-17cb7b36ab3b req-0ce19225-b1e6-40b7-b297-c918166ab6e6 service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG nova.compute.manager [req-1375a453-8035-4a0b-bb86-17cb7b36ab3b req-0ce19225-b1e6-40b7-b297-c918166ab6e6 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] No waiting events found dispatching network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:21:49 user nova-compute[74131]: WARNING nova.compute.manager [req-1375a453-8035-4a0b-bb86-17cb7b36ab3b req-0ce19225-b1e6-40b7-b297-c918166ab6e6 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received unexpected event network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 for instance with vm_state building and task_state spawning.
Oct 20 17:21:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:49 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-a8c3ef2a-5fbb-40a1-8342-e16807690184 req-2f162e16-e07d-412c-b461-868574400ba6 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a8c3ef2a-5fbb-40a1-8342-e16807690184 req-2f162e16-e07d-412c-b461-868574400ba6 service nova] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a8c3ef2a-5fbb-40a1-8342-e16807690184 req-2f162e16-e07d-412c-b461-868574400ba6 service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-a8c3ef2a-5fbb-40a1-8342-e16807690184 req-2f162e16-e07d-412c-b461-868574400ba6 service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.compute.manager [req-a8c3ef2a-5fbb-40a1-8342-e16807690184 req-2f162e16-e07d-412c-b461-868574400ba6 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] No waiting events found dispatching network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:21:51 user nova-compute[74131]: WARNING nova.compute.manager [req-a8c3ef2a-5fbb-40a1-8342-e16807690184 req-2f162e16-e07d-412c-b461-868574400ba6 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received unexpected event network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 for instance with vm_state building and task_state spawning.
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Instance event wait completed in 0 seconds for  {{(pid=74131) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Guest created on hypervisor {{(pid=74131) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 17:21:51 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Instance spawned successfully.
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Found default for hw_cdrom_bus of ide {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Found default for hw_disk_bus of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Found default for hw_input_bus of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Found default for hw_pointer_model of None {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Found default for hw_video_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:21:51 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Found default for hw_vif_model of virtio {{(pid=74131) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 17:21:52 user nova-compute[74131]: INFO nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Took 7.01 seconds to spawn the instance on the hypervisor.
Oct 20 17:21:52 user nova-compute[74131]: DEBUG nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Checking state {{(pid=74131) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 17:21:52 user nova-compute[74131]: INFO nova.compute.manager [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Took 7.75 seconds to build instance.
Oct 20 17:21:52 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-da789dfc-67c6-4b14-851e-cb6292a66468 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.902s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:21:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:56 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:21:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:01 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:05 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:22:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:22:10 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:22:10 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:22:10 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:22:11 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:22:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:22:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:22:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:22:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:22:13 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:22:13 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:22:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:22:14 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:22:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=24.984352111816406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:22:14 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:22:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:22:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:22:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:22:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:22:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:22:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:22:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:22:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:02 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:23:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:23:10 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:23:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:23:14 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:23:14 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:23:15 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:23:15 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:23:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=24.96399688720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:23:15 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:23:16 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:23:16 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:23:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:23:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:23:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:23:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-changed-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG nova.compute.manager [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Refreshing instance network info cache due to event network-changed-871fb124-0e16-4855-bd8c-5844217ba9d4. {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Refreshing network info cache for port 871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated VIF entry in instance network info cache for port 871fb124-0e16-4855-bd8c-5844217ba9d4. {{(pid=74131) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG nova.network.neutron [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:23:35 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-fe461a87-1bfb-44b9-8aab-134b9188da02 req-ec20acd0-8c50-44ee-b2c4-f45d60624bc7 service nova] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:23:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:23:47 user nova-compute[74131]: INFO nova.compute.manager [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attaching volume 0e46413a-2010-4f7a-a465-e4b17d380aec to /dev/vdb
Oct 20 17:23:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG os_brick.utils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a7cf16-4045-4b82-95d3-16966f493732]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a100890-6fbd-4937-9527-4deb03bd1549]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d5e37d-0255-4423-8d5c-447b5400de2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c370a-6cb9-4359-96d0-b12672e37699]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:23:47 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:23:47 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30017f1-a587-4bea-99a1-8038c4bfbbe2]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG os_brick.utils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:23:47 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating existing volume attachment record: 684d93f6-eb92-4ea5-9477-4ffb66a737c3 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:23:51 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:23:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqSFzRjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:24:04 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:24:04 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:24:04 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aa4113-8016-4aef-a7d1-b97d55dce564]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:24:04 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[40489bda-562d-4c5b-8aff-7c5222dfa68e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec] added
Oct 20 17:24:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2161e-b81c-46d7-9fd3-30c26cc290fb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec5504b-f7f3-4191-a9e3-983cfd7a3851]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqSFzRjP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqSFzRjP" returned: 0 in 0.051s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2813f65-9ff9-4ae8-80ea-13cdf1fc2e40]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqSFzRjP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fa7d5f-3da6-41ff-addb-b03a254ee48b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69eb0f-a3fb-4a51-b419-862c5b820ec9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:24:04 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:24:04 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:24:04 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:24:04 user nova-compute[74131]: 
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bfd6ed-b3c9-4f19-b564-d60eeae92caa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260]
Oct 20 17:24:04 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260] successful.
Oct 20 17:24:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b217f-17fa-4796-8588-4003f65caa4a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4c644-99ff-4a49-8329-606a6c5d7476]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec (non-flash)
Oct 20 17:24:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec (non-flash)
Oct 20 17:24:04 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdcf71a-6bb2-45af-b7bb-6d0353d53bdb]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqSFzRjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:24:04 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26435396134393061', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435396134393061', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG nova.objects.instance [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:24:05 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:24:05 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:24:05 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:24:05 user nova-compute[74131]:   <serial>0e46413a-2010-4f7a-a465-e4b17d380aec</serial>
Oct 20 17:24:05 user nova-compute[74131]: </disk>
Oct 20 17:24:05 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No VIF found with MAC fa:16:3e:fe:42:8b, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:24:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-0a702471-3bad-4b09-bb4f-c43bce5bc0f8 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.535s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:24:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:24:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:24:12 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:24:12 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:24:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:24:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:12 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:24:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:24:16 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:24:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:17 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:24:17 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=24.95364761352539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:24:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:24:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:24:22 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:24:26 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:31 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:24:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:24:50 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:24:50 user nova-compute[74131]: INFO nova.compute.manager [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Detaching volume 0e46413a-2010-4f7a-a465-e4b17d380aec
Oct 20 17:24:50 user nova-compute[74131]: INFO nova.virt.block_device [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attempting to driver detach volume 0e46413a-2010-4f7a-a465-e4b17d380aec from mountpoint /dev/vdb
Oct 20 17:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Attempting to detach device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:24:50 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:24:50 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:24:50 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:24:50 user nova-compute[74131]:   <serial>0e46413a-2010-4f7a-a465-e4b17d380aec</serial>
Oct 20 17:24:50 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:24:50 user nova-compute[74131]: </disk>
Oct 20 17:24:50 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:24:50 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config.
Oct 20 17:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:24:50 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:24:50 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:24:50 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:24:50 user nova-compute[74131]:   <serial>0e46413a-2010-4f7a-a465-e4b17d380aec</serial>
Oct 20 17:24:50 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:24:50 user nova-compute[74131]: </disk>
Oct 20 17:24:50 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:24:50 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:24:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:24:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:25:06 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:10 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 is timed out.
Oct 20 17:25:10 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config.
Oct 20 17:25:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqSFzRjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:25:10 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d2ff1-3985-4b18-93a2-7fe918e762db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:25:10 user nova-compute[74131]: No targets found.
Oct 20 17:25:10 user nova-compute[74131]: iSNS:
Oct 20 17:25:10 user nova-compute[74131]: No targets found.
Oct 20 17:25:10 user nova-compute[74131]: STATIC:
Oct 20 17:25:10 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec
Oct 20 17:25:10 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:25:10 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:25:10 user nova-compute[74131]: FIRMWARE:
Oct 20 17:25:10 user nova-compute[74131]: No targets found.
Oct 20 17:25:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:25:10 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:25:10 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f06407-0bd0-4eef-800a-75c6c8fcaeda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c573924-ee89-409a-8eb1-c6ef46ebb6b3]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec (non-flash)
Oct 20 17:25:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec (non-flash)
Oct 20 17:25:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87efa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57bdea4-ba8a-48a5-a1d2-0460f3be25a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac118b17-92de-4757-a733-63f6113b0b58]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd5c3b-f269-4338-b8d8-c0640d7f4e7a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fe50eb-b4d1-4684-858e-c0fd37b2139b]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3c4a15-b01a-445b-b7c6-fa1ab2e09b22]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba02b4-90c3-44c9-947a-5cbb9dda1745]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260]
Oct 20 17:25:10 user nova-compute[74131]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec, portal: 172.16.0.220,3260] successful.
Oct 20 17:25:10 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e46413a-2010-4f7a-a465-e4b17d380aec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[873bcef1-b4e3-4e77-b661-618072b55d81]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== disconnect_volume: return (286ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:25:10 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:25:11 user nova-compute[74131]: DEBUG nova.objects.instance [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:25:11 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-8eb5f256-28c0-4a60-a1af-9c4f54f54ec4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:25:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:25:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:25:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:25:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:25:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:25:13 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:25:14 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:25:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:25:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:25:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:25:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:25:17 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:25:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:18 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:25:18 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:25:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=24.952560424804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:25:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:25:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:25:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:25:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:25:45 user nova-compute[74131]: INFO nova.compute.manager [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attaching volume 8b5e9b35-0183-4689-8a2d-fd01b5329a36 to /dev/vdb
Oct 20 17:25:45 user nova-compute[74131]: DEBUG os_brick.utils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dce0bc-266a-4717-b466-60ad3e255fed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c59f771-5bc0-4a1c-8c30-8cd8ce17aac0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfeba0-2b1e-454e-bf84-35af7c875da7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab02bdb-319c-40b2-a73d-e5ebcde73c56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:25:45 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:25:45 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409e370-6217-447c-9e78-03de9f0e74cc]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG os_brick.utils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:25:45 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating existing volume attachment record: c3f8fe07-45ec-46d8-b34c-bcf7d8df1d17 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:25:46 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:25:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:25:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:25:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZqNJHAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:26:01 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:26:01 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:26:01 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea53b28d-b9b9-4f4f-b68a-7bc56275691a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:26:01 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5ec01-37c4-4fee-89a3-a8a9f9837585]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36] added
Oct 20 17:26:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[64345508-81a9-4432-be2b-157cd46e4f30]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[47553bfe-8e94-4947-a7c9-cc6c798871a3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZqNJHAh {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZqNJHAh" returned: 0 in 0.027s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d88c0c8-ede1-4c2b-8bfa-4fe71fa43663]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZqNJHAh'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9921148-12d0-46ca-b280-b91a704f6988]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb817c2-74c4-45e2-8b2d-8653642bf82c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:26:01 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:26:01 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:26:01 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:26:01 user nova-compute[74131]: 
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f8fb8-d3ba-418e-8bba-288907a1296f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260]
Oct 20 17:26:01 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260] successful.
Oct 20 17:26:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[db12bb57-5fa6-4a15-98b7-ae1893dfc5a6]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f047c-90a7-43a6-ace9-6ec017698023]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 (non-flash)
Oct 20 17:26:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 (non-flash)
Oct 20 17:26:01 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e06d80-b6d8-48c2-8606-b007af6c67df]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:01 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZqNJHAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23135663061613338', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135663061613338', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG nova.objects.instance [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:26:02 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:26:02 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:26:02 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:26:02 user nova-compute[74131]:   <serial>8b5e9b35-0183-4689-8a2d-fd01b5329a36</serial>
Oct 20 17:26:02 user nova-compute[74131]: </disk>
Oct 20 17:26:02 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:26:02 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No VIF found with MAC fa:16:3e:fe:42:8b, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:26:03 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-bee478de-3b33-49a7-aff5-3630cc90c36c tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.481s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:26:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:26:05 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:26:05 user nova-compute[74131]: INFO nova.compute.manager [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Detaching volume 8b5e9b35-0183-4689-8a2d-fd01b5329a36
Oct 20 17:26:05 user nova-compute[74131]: INFO nova.virt.block_device [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attempting to driver detach volume 8b5e9b35-0183-4689-8a2d-fd01b5329a36 from mountpoint /dev/vdb
Oct 20 17:26:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Attempting to detach device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:26:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:26:05 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:26:05 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:26:05 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:26:05 user nova-compute[74131]:   <serial>8b5e9b35-0183-4689-8a2d-fd01b5329a36</serial>
Oct 20 17:26:05 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:26:05 user nova-compute[74131]: </disk>
Oct 20 17:26:05 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:26:05 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config.
Oct 20 17:26:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:26:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:26:05 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:26:05 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:26:05 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:26:05 user nova-compute[74131]:   <serial>8b5e9b35-0183-4689-8a2d-fd01b5329a36</serial>
Oct 20 17:26:05 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:26:05 user nova-compute[74131]: </disk>
Oct 20 17:26:05 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:26:05 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:26:06 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:26:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:26:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 17:26:07 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 17:26:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:11 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:26:13 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:26:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:26:13 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:26:13 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:26:13 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:26:14 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:26:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:26:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:26:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:26:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:26:19 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:26:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:26:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=24.951534271240234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:26:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:26:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:23 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:25 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 is timed out.
Oct 20 17:26:25 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config.
Oct 20 17:26:25 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZqNJHAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:26:25 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af513bc-9d12-4826-8f83-f0fecfc94274]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:26:25 user nova-compute[74131]: No targets found.
Oct 20 17:26:25 user nova-compute[74131]: iSNS:
Oct 20 17:26:25 user nova-compute[74131]: No targets found.
Oct 20 17:26:25 user nova-compute[74131]: STATIC:
Oct 20 17:26:25 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36
Oct 20 17:26:25 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:26:25 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:26:25 user nova-compute[74131]: FIRMWARE:
Oct 20 17:26:25 user nova-compute[74131]: No targets found.
Oct 20 17:26:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:26:25 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:26:25 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7805e81-5141-4fb1-a3af-77a9ae9ece81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[904480b4-c22c-4512-8f07-e005c7a26429]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 (non-flash)
Oct 20 17:26:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 (non-flash)
Oct 20 17:26:25 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87aa560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b85b36-31a7-46aa-b193-715afedae4b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce881c5-7273-481c-9b49-f2afdfd35bef]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b724f23-52c4-4daa-a520-7cc46ac5166f]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[84adf434-d025-46a4-9afb-25be42057150]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ff8d5-648e-44e0-a5fd-1cb1f41f7fbf]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:25 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab362500-6224-4186-ae6c-b31b1ed0ee06]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260]
Oct 20 17:26:26 user nova-compute[74131]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36, portal: 172.16.0.220,3260] successful.
Oct 20 17:26:26 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b5e9b35-0183-4689-8a2d-fd01b5329a36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e766cdea-30bb-448e-b201-077f843413f2]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== disconnect_volume: return (288ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG nova.objects.instance [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:26:26 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-46254335-031f-4cf9-a3e6-89ce012c4427 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:26:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:26:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Triggering sync for uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 17:26:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:26:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:26:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:26:33 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:26:33 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 17:26:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:26:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:26:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG nova.objects.instance [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:27:00 user nova-compute[74131]: INFO nova.compute.manager [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attaching volume 8507efb5-44cc-4846-b524-73f8bf0ba833 to /dev/vdb
Oct 20 17:27:00 user nova-compute[74131]: DEBUG os_brick.utils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:00 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf1c667-6f74-48ba-95df-cab84c1a6394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3dfc6f-69f0-4a78-8e6b-8f3989686df9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[81726434-cd14-48f2-affe-efbb75deac50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb275cfc-37b3-4314-8aed-3944c0322ac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:27:01 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:27:01 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf075318-265a-4f41-8edf-635688dc18af]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG os_brick.utils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating existing volume attachment record: 584da401-8da3-425e-8ae2-290363c219a6 {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:27:01 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:27:07 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:27:14 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:27:14 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:27:14 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:27:14 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:27:15 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:27:15 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:27:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYCNFJti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:27:16 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:27:16 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:27:16 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d78eea9-297c-4cff-9cfa-60cc55cd83ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:27:16 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3845d6e5-978d-4fe3-bde1-3ddb526e7f4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833] added
Oct 20 17:27:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d76ec-b867-4f0a-9671-aeb7119b63eb]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc24c0d-a8af-4369-bfc7-0e03858527c0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYCNFJti {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYCNFJti" returned: 0 in 0.024s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[10883782-f796-4db4-943f-e9b7ccce94f0]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYCNFJti'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe71feb-0c08-42a1-8712-03921cc5ab07]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df4357e-5372-43a6-bf9b-2025a2a4e72b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:27:16 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:27:16 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:27:16 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:27:16 user nova-compute[74131]: 
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e38e0f9-c297-41e9-9444-7c778ebb9184]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260]
Oct 20 17:27:16 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260] successful.
Oct 20 17:27:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a59baaf-f8b9-40df-9444-5c0a1f8b466b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bcced4-4107-432f-9278-2dc04b221aa1]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 (non-flash)
Oct 20 17:27:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 (non-flash)
Oct 20 17:27:16 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[9907894e-1089-47e7-91e6-036a20a47171]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:16 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYCNFJti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26138323037383065', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:27:17 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138323037383065', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:27:18 user nova-compute[74131]: DEBUG nova.objects.instance [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:27:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:27:18 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:27:18 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:27:18 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:27:18 user nova-compute[74131]:   <serial>8507efb5-44cc-4846-b524-73f8bf0ba833</serial>
Oct 20 17:27:18 user nova-compute[74131]: </disk>
Oct 20 17:27:18 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:27:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:27:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:27:18 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No VIF found with MAC fa:16:3e:fe:42:8b, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:27:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-270ca440-5541-4c79-99f3-8aa2fa8bf68b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.633s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:27:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:27:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:27:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:27:19 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:27:19 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74131) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 17:27:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:27:20 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.950607299804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:27:20 user nova-compute[74131]: INFO nova.compute.manager [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Detaching volume 8507efb5-44cc-4846-b524-73f8bf0ba833
Oct 20 17:27:20 user nova-compute[74131]: INFO nova.virt.block_device [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attempting to driver detach volume 8507efb5-44cc-4846-b524-73f8bf0ba833 from mountpoint /dev/vdb
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Attempting to detach device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:27:20 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:27:20 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:27:20 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:27:20 user nova-compute[74131]:   <serial>8507efb5-44cc-4846-b524-73f8bf0ba833</serial>
Oct 20 17:27:20 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:27:20 user nova-compute[74131]: </disk>
Oct 20 17:27:20 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:27:20 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config.
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:27:20 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:27:20 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:27:20 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:27:20 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:27:20 user nova-compute[74131]:   <serial>8507efb5-44cc-4846-b524-73f8bf0ba833</serial>
Oct 20 17:27:20 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:27:20 user nova-compute[74131]: </disk>
Oct 20 17:27:20 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:27:21 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:27:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:25 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:27:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:27:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:41 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 is timed out.
Oct 20 17:27:41 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config.
Oct 20 17:27:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYCNFJti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:27:41 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a1c23-b6ac-45cd-b00d-f50c59821b46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:27:41 user nova-compute[74131]: No targets found.
Oct 20 17:27:41 user nova-compute[74131]: iSNS:
Oct 20 17:27:41 user nova-compute[74131]: No targets found.
Oct 20 17:27:41 user nova-compute[74131]: STATIC:
Oct 20 17:27:41 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833
Oct 20 17:27:41 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:27:41 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:27:41 user nova-compute[74131]: FIRMWARE:
Oct 20 17:27:41 user nova-compute[74131]: No targets found.
Oct 20 17:27:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:27:41 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:27:41 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c537e02-6656-4e12-a9e5-35d77cb6cb5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e15b71-9633-4479-9adb-1158a7c1992c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 (non-flash)
Oct 20 17:27:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 (non-flash)
Oct 20 17:27:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70c81f27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed0327b-f91e-4f94-b07e-464068c2c08e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85892ef-4018-400a-a670-650cde41103d]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb118471-945a-456b-98e6-3f0ae16595b4]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9f916-e533-4228-9970-72745eea9f89]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c0abc-8d2c-4b1f-8cf3-957650e29520]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7613cff-b2bc-442f-bcda-f15f9a2e0c01]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260]
Oct 20 17:27:41 user nova-compute[74131]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833, portal: 172.16.0.220,3260] successful.
Oct 20 17:27:41 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8507efb5-44cc-4846-b524-73f8bf0ba833 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a89d53d-5a42-4453-bdc0-176397580d32]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== disconnect_volume: return (302ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:27:41 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:27:42 user nova-compute[74131]: DEBUG nova.objects.instance [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:27:42 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-02e7e8b6-f2d8-4f5f-9d08-f7b2d5828088 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:27:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:27:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:27:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:27:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:28:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:08 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:10 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:15 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:28:15 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:28:16 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:28:17 user nova-compute[74131]: INFO nova.compute.manager [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attaching volume bb78c22f-c111-42f7-9cb0-559b46535a63 to /dev/vdb
Oct 20 17:28:17 user nova-compute[74131]: DEBUG os_brick.utils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ab7ad-c455-4f79-adc3-06c9d5ac1467]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9a2510d45d7c\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd0897-cb12-4fb2-b883-77e6a28c9ff7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa65e29-a9b1-46c5-8ab3-2c0b4098d97b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6798d83-814b-419b-abad-d993937aeb73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Running cmd (subprocess): nvme version {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] 'nvme version' failed. Not Retrying. {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] nvme not present on system {{(pid=74131) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 17:28:17 user nova-compute[74131]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a220fd-4003-46a9-a152-7e571e7b9745]: (4, '') {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74131) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] LIGHTOS: no hostnqn found. {{(pid=74131) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG os_brick.utils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a2510d45d7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG nova.virt.block_device [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating existing volume attachment record: 58c799dd-8f58-4fae-a463-e78c5b48c41e {{(pid=74131) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:28:18 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:28:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:28:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:28:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:28:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.949787139892578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:28:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:28:22 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:28:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:28:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:28:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:28:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:26 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:28:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:28:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Calling os-brick to attach iSCSI Volume {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlVMpSOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:28:33 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:28:33 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:28:33 user nova-compute[74131]: INFO os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d14aa-d515-446c-b88b-930c1dc6e357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 17:28:33 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --interface default --op new {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff00c40-c7ea-4e0c-8f9e-3e47a0ad02fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63] added\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63] added
Oct 20 17:28:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[99da4ac4-56bd-42da-a437-30a97b7af293]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73ca88e-6790-476a-8707-cd23b6309f67]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlVMpSOw {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlVMpSOw" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f21f4-03e8-4f47-bfa0-fad5be3cc4e3]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IlVMpSOw'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d7c73-9bb3-4efb-a686-e8f556013f3b]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b880e-990e-424d-804e-3d113fe9b834]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:28:33 user nova-compute[74131]:  {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 17:28:33 user nova-compute[74131]:  {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:28:33 user nova-compute[74131]: WARNING os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 17:28:33 user nova-compute[74131]: 
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --login {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f37049d-4f93-4f0c-a442-3febc28a0aa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260]
Oct 20 17:28:33 user nova-compute[74131]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260] successful.
Oct 20 17:28:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4609865c-5177-4f3b-8a31-5de94608f126]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d41707f-50c3-4686-a52e-360c84d51c7f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 (non-flash)
Oct 20 17:28:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 (non-flash)
Oct 20 17:28:33 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to 172.16.0.220:3260 {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74131) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74131) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e0d30-c8b7-49fd-a8ca-f551eec42147]: (4, ('- - 0', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:33 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74131) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlVMpSOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74131) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26566646339393063', 'path': '/dev/sdb'} {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566646339393063', 'path': '/dev/sdb'} {{(pid=74131) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG nova.objects.instance [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 17:28:34 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:28:34 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:28:34 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:28:34 user nova-compute[74131]:   <serial>bb78c22f-c111-42f7-9cb0-559b46535a63</serial>
Oct 20 17:28:34 user nova-compute[74131]: </disk>
Oct 20 17:28:34 user nova-compute[74131]:  {{(pid=74131) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vda, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74131) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] No VIF found with MAC fa:16:3e:fe:42:8b, not building metadata {{(pid=74131) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 17:28:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-7fe73fc3-5545-4c52-b3ed-1ba068483ee4 tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.862s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:28:36 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:28:37 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:28:37 user nova-compute[74131]: INFO nova.compute.manager [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Detaching volume bb78c22f-c111-42f7-9cb0-559b46535a63
Oct 20 17:28:37 user nova-compute[74131]: INFO nova.virt.block_device [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Attempting to driver detach volume bb78c22f-c111-42f7-9cb0-559b46535a63 from mountpoint /dev/vdb
Oct 20 17:28:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Attempting to detach device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config. {{(pid=74131) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 17:28:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:28:37 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:28:37 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:28:37 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:28:37 user nova-compute[74131]:   <serial>bb78c22f-c111-42f7-9cb0-559b46535a63</serial>
Oct 20 17:28:37 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:28:37 user nova-compute[74131]: </disk>
Oct 20 17:28:37 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:28:37 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the persistent domain config.
Oct 20 17:28:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config. {{(pid=74131) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 17:28:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.guest [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 17:28:37 user nova-compute[74131]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 17:28:37 user nova-compute[74131]:   <source dev="/dev/sdb"/>
Oct 20 17:28:37 user nova-compute[74131]:   <target dev="vdb" bus="virtio"/>
Oct 20 17:28:37 user nova-compute[74131]:   <serial>bb78c22f-c111-42f7-9cb0-559b46535a63</serial>
Oct 20 17:28:37 user nova-compute[74131]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 17:28:37 user nova-compute[74131]: </disk>
Oct 20 17:28:37 user nova-compute[74131]:  {{(pid=74131) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 17:28:37 user nova-compute[74131]: DEBUG nova.virt.libvirt.driver [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 17:28:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:41 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:28:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:57 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 is timed out.
Oct 20 17:28:57 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully detached device vdb from instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 from the live domain config.
Oct 20 17:28:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] calling os-brick to detach iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f70c87eceb0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlVMpSOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 17:28:57 user nova-compute[74131]: WARNING os_brick.initiator.connectors.base [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[453e68c8-16c2-4c02-89b7-5b32207343d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 17:28:57 user nova-compute[74131]: No targets found.
Oct 20 17:28:57 user nova-compute[74131]: iSNS:
Oct 20 17:28:57 user nova-compute[74131]: No targets found.
Oct 20 17:28:57 user nova-compute[74131]: STATIC:
Oct 20 17:28:57 user nova-compute[74131]: Target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63
Oct 20 17:28:57 user nova-compute[74131]:         Portal: 172.16.0.220:3260,-1
Oct 20 17:28:57 user nova-compute[74131]:                 Iface Name: default
Oct 20 17:28:57 user nova-compute[74131]: FIRMWARE:
Oct 20 17:28:57 user nova-compute[74131]: No targets found.
Oct 20 17:28:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 17:28:57 user nova-compute[74131]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 17:28:57 user nova-compute[74131]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74131) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63', 0)] {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd949f6f-005f-4fed-a757-7f23a10c8ed7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4dc12b-9551-47f3-872c-ad747187e974]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 (non-flash)\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 (non-flash)
Oct 20 17:28:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 (non-flash)
Oct 20 17:28:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f70a87bc550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63'): ({'sdb'}, set())}) {{(pid=74131) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Removing single pathed devices sdb {{(pid=74131) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[14abdbc2-1fa6-44a5-8270-444984595544]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1144a3-ff18-48fe-9fac-965f09abf3cd]: (4, ('ok\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Flushing IO for device /dev/sdb {{(pid=74131) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec9867c-2047-4b11-89ed-a54c0bcd9a1a]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74131) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2f59bd-a50e-4546-bc44-bfb25878008c]: (4, ('1', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.linuxscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] SCSI volumes sdb have been removed. {{(pid=74131) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63')] {{(pid=74131) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ab58da-0f5d-4eb8-8a4a-2ccae678f549]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --logout {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df87935-123d-46cd-86fc-f8cad075bb62]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260]
Oct 20 17:28:57 user nova-compute[74131]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63, portal: 172.16.0.220,3260] successful.
Oct 20 17:28:57 user nova-compute[74131]:  stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op delete {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb78c22f-c111-42f7-9cb0-559b46535a63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84843) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG oslo.privsep.daemon [-] privsep: reply[8515ab5a-37bd-4cfe-acb6-7ea9f393bb69]: (4, ('', '')) {{(pid=84843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74131) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.base [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG os_brick.initiator.connectors.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] <== disconnect_volume: return (306ms) None {{(pid=74131) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 17:28:57 user nova-compute[74131]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Disconnected iSCSI Volume {{(pid=74131) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 17:28:58 user nova-compute[74131]: DEBUG nova.objects.instance [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'flavor' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:28:58 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-1318d8b8-cdd7-4756-b322-f5cc30900a9a tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:29:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:29:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:29:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:29:17 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:29:18 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:29:18 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:29:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:29:18 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:18 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:29:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:29:20 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:29:20 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:29:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:29:21 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:29:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=24.94887924194336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:29:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:29:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:29:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:29:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:29:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:37 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:42 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:29:47 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:52 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:29:57 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:02 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:07 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:12 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:14 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:30:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:30:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:30:17 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:30:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:30:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 17:30:19 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquired lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 17:30:19 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Forcefully refreshing network info cache for instance {{(pid=74131) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 17:30:19 user nova-compute[74131]: DEBUG nova.objects.instance [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lazy-loading 'info_cache' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:30:20 user nova-compute[74131]: DEBUG nova.network.neutron [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [{"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:30:20 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Releasing lock "refresh_cache-64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" {{(pid=74131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 17:30:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updated the network info_cache for instance {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 17:30:20 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:20 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:30:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:30:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:30:21 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.processutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74131) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 17:30:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:30:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:30:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.940109252929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74131) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:30:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:30:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:28 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:30:32 user nova-compute[74131]: INFO nova.compute.manager [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Terminating instance
Oct 20 17:30:32 user nova-compute[74131]: DEBUG nova.compute.manager [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Start destroying the instance on the hypervisor. {{(pid=74131) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-cdb74a2a-9c10-4d10-b44a-7588ee7b9f3b req-06727f0c-5f17-4b00-95c3-8e544a65f239 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-vif-unplugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cdb74a2a-9c10-4d10-b44a-7588ee7b9f3b req-06727f0c-5f17-4b00-95c3-8e544a65f239 service nova] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cdb74a2a-9c10-4d10-b44a-7588ee7b9f3b req-06727f0c-5f17-4b00-95c3-8e544a65f239 service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-cdb74a2a-9c10-4d10-b44a-7588ee7b9f3b req-06727f0c-5f17-4b00-95c3-8e544a65f239 service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-cdb74a2a-9c10-4d10-b44a-7588ee7b9f3b req-06727f0c-5f17-4b00-95c3-8e544a65f239 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] No waiting events found dispatching network-vif-unplugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG nova.compute.manager [req-cdb74a2a-9c10-4d10-b44a-7588ee7b9f3b req-06727f0c-5f17-4b00-95c3-8e544a65f239 service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-vif-unplugged-871fb124-0e16-4855-bd8c-5844217ba9d4 for instance with task_state deleting. {{(pid=74131) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:32 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [-] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Instance destroyed successfully.
Oct 20 17:30:33 user nova-compute[74131]: DEBUG nova.objects.instance [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lazy-loading 'resources' on Instance uuid 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4 {{(pid=74131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG nova.virt.libvirt.vif [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T17:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-455108372',display_name='tempest-SnapshotDataIntegrityTests-server-455108372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-455108372',id=53,image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwy7wkV2r1duEEVmC52fBsBrzsXopvdvhfICOlhNofFG5VNhQYpjCyrZr3r7Bcnn3ndbonwq3yS5elk91TBcdMqVJtVMgy2wFpu1i0zy6huaA2AaYmF7vT1hiwR11hvoA==',key_name='tempest-keypair-3662127',keypairs=<?>,launch_index=0,launched_at=2023-10-20T17:21:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79e44fc36c814cdb8ea6c71d781c06fa',ramdisk_id='',reservation_id='r-3d5or7b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5632de9b-7b89-4624-9137-cb6ef38be112',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-352806666',owner_user_name='tempest-SnapshotDataIntegrityTests-352806666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T17:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f155e3b888b243caac6e6967fcbdbd23',uuid=64ff9b13-0c66-4265-a5cd-7bc6c155c1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Converting VIF {"id": "871fb124-0e16-4855-bd8c-5844217ba9d4", "address": "fa:16:3e:fe:42:8b", "network": {"id": "ce80a6d2-25c7-4432-a1d7-7e963fa28f90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1250602664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e44fc36c814cdb8ea6c71d781c06fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871fb124-0e", "ovs_interfaceid": "871fb124-0e16-4855-bd8c-5844217ba9d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG nova.network.os_vif_util [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:42:8b,bridge_name='br-int',has_traffic_filtering=True,id=871fb124-0e16-4855-bd8c-5844217ba9d4,network=Network(ce80a6d2-25c7-4432-a1d7-7e963fa28f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871fb124-0e') {{(pid=74131) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG os_vif [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:42:8b,bridge_name='br-int',has_traffic_filtering=True,id=871fb124-0e16-4855-bd8c-5844217ba9d4,network=Network(ce80a6d2-25c7-4432-a1d7-7e963fa28f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871fb124-0e') {{(pid=74131) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap871fb124-0e, bridge=br-int, if_exists=True) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=696f85be-4be2-4846-8420-01beb9617aa7) {{(pid=74131) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:33 user nova-compute[74131]: INFO os_vif [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:42:8b,bridge_name='br-int',has_traffic_filtering=True,id=871fb124-0e16-4855-bd8c-5844217ba9d4,network=Network(ce80a6d2-25c7-4432-a1d7-7e963fa28f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871fb124-0e')
Oct 20 17:30:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Deleting instance files /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4_del
Oct 20 17:30:33 user nova-compute[74131]: INFO nova.virt.libvirt.driver [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Deletion of /opt/stack/data/nova/instances/64ff9b13-0c66-4265-a5cd-7bc6c155c1f4_del complete
Oct 20 17:30:33 user nova-compute[74131]: INFO nova.compute.manager [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 17:30:33 user nova-compute[74131]: DEBUG oslo.service.loopingcall [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74131) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG nova.compute.manager [-] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Deallocating network for instance {{(pid=74131) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] deallocate_for_instance() {{(pid=74131) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG nova.network.neutron [-] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Updating instance_info_cache with network_info: [] {{(pid=74131) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 17:30:33 user nova-compute[74131]: INFO nova.compute.manager [-] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Took 0.75 seconds to deallocate network for instance.
Oct 20 17:30:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:30:33 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-f026d000-73d8-451e-bc56-4b5f1bbe85dc req-2fcdbbba-34d7-48ff-b2ba-d6dcdd5aa22b service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-vif-deleted-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:30:34 user nova-compute[74131]: INFO nova.scheduler.client.report [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Deleted allocations for instance 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4
Oct 20 17:30:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-ab3666d4-cfab-4725-9e61-2c26c81c754b tempest-SnapshotDataIntegrityTests-352806666 tempest-SnapshotDataIntegrityTests-352806666-project-member] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b2afe46-b2b0-4ce4-9ccc-1a64f474f632 req-d6a1d6e2-e19a-4d37-9d77-c795dd84b3fb service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received event network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b2afe46-b2b0-4ce4-9ccc-1a64f474f632 req-d6a1d6e2-e19a-4d37-9d77-c795dd84b3fb service nova] Acquiring lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b2afe46-b2b0-4ce4-9ccc-1a64f474f632 req-d6a1d6e2-e19a-4d37-9d77-c795dd84b3fb service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [req-2b2afe46-b2b0-4ce4-9ccc-1a64f474f632 req-d6a1d6e2-e19a-4d37-9d77-c795dd84b3fb service nova] Lock "64ff9b13-0c66-4265-a5cd-7bc6c155c1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:30:34 user nova-compute[74131]: DEBUG nova.compute.manager [req-2b2afe46-b2b0-4ce4-9ccc-1a64f474f632 req-d6a1d6e2-e19a-4d37-9d77-c795dd84b3fb service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] No waiting events found dispatching network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 {{(pid=74131) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 17:30:34 user nova-compute[74131]: WARNING nova.compute.manager [req-2b2afe46-b2b0-4ce4-9ccc-1a64f474f632 req-d6a1d6e2-e19a-4d37-9d77-c795dd84b3fb service nova] [instance: 64ff9b13-0c66-4265-a5cd-7bc6c155c1f4] Received unexpected event network-vif-plugged-871fb124-0e16-4855-bd8c-5844217ba9d4 for instance with vm_state deleted and task_state None.
Oct 20 17:30:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:30:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:30:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:30:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:30:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:30:58 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74131) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 17:31:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:31:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74131) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 17:31:03 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:08 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:09 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:12 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:13 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:13 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:16 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:18 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:19 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 17:31:19 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] There are 0 instances to clean {{(pid=74131) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Starting heal instance info cache {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Rebuilding the list of instances to heal {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Didn't find any instances for network info cache update. {{(pid=74131) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74131) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:31:21 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Auditing locally available compute resources for user (node: user) {{(pid=74131) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 17:31:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:31:22 user nova-compute[74131]: WARNING nova.virt.libvirt.driver [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=24.967529296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74131) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74131) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing inventories for resource provider bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating ProviderTree inventory for provider bae45930-01a8-4277-ad36-8055d9898c12 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Updating inventory in ProviderTree for provider bae45930-01a8-4277-ad36-8055d9898c12 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing aggregate associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, aggregates: None {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Refreshing trait associations for resource provider bae45930-01a8-4277-ad36-8055d9898c12, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74131) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.compute.provider_tree [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed in ProviderTree for provider: bae45930-01a8-4277-ad36-8055d9898c12 {{(pid=74131) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.scheduler.client.report [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Inventory has not changed for provider bae45930-01a8-4277-ad36-8055d9898c12 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74131) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG nova.compute.resource_tracker [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Compute_service record updated for user:user {{(pid=74131) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 17:31:22 user nova-compute[74131]: DEBUG oslo_concurrency.lockutils [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=74131) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 17:31:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:23 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:24 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:27 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:27 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:28 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:29 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:33 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 17:31:38 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:43 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:45 user nova-compute[74131]: DEBUG oslo_service.periodic_task [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74131) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 17:31:45 user nova-compute[74131]: DEBUG nova.compute.manager [None req-83ded0e1-0c3c-432c-a84b-db9fac3dbd11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74131) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 17:31:48 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 17:31:53 user nova-compute[74131]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74131) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}